[ 522.770108] env[65249]: /opt/stack/neutron/neutron/__init__.py:25: UserWarning: The selected oslo_service backend is "eventlet" [ 522.770108] env[65249]: warnings.warn('The selected oslo_service backend is "eventlet"') [ 523.776266] env[65337]: /opt/stack/neutron/neutron/__init__.py:25: UserWarning: The selected oslo_service backend is "eventlet" [ 523.776266] env[65337]: warnings.warn('The selected oslo_service backend is "eventlet"') [ 525.593258] env[65337]: INFO neutron.common.config [-] Logging enabled! [ 525.593671] env[65337]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 28.0.0.0b2.dev40 [ 525.593753] env[65337]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=65337) setup_logging /opt/stack/neutron/neutron/common/config.py:124}} [ 525.594081] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ... [ 525.594260] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed. [ 525.594954] env[65337]: WARNING oslo_policy.policy [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 525.595207] env[65337]: WARNING oslo_policy.policy [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 525.596814] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] VMware NSXv3 Agent initialized successfully. [ 525.597184] env[65337]: DEBUG oslo_concurrency.lockutils [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] Acquiring lock "singleton_lock" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 525.597314] env[65337]: DEBUG oslo_concurrency.lockutils [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] Acquired lock "singleton_lock" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 525.597508] env[65337]: DEBUG oslo_concurrency.lockutils [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] Releasing lock "singleton_lock" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 525.597782] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] Full set of CONF: {{(pid=65337) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:275}} [ 525.597899] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] ******************************************************************************** {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} [ 525.597994] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] Configuration options gathered from: {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} [ 525.598543] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--config-file', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} [ 525.599212] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} [ 525.599212] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] ================================================================================ {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} [ 525.599212] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] agent_down_time = 75 {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.599212] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] allow_automatic_dhcp_failover = True {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.599590] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] allow_bulk = True {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.599590] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] api_extensions_path = {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.599590] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] api_paste_config = api-paste.ini {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.599815] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] auth_strategy = keystone {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.599815] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] backdoor_port = None {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.599815] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] backdoor_socket = None {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.600018] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] backlog = 4096 {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.600095] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] base_mac = fa:16:3e:00:00:00 {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.600255] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] bind_host = 0.0.0.0 {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.600394] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] bind_port = 9696 {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.600526] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] client_socket_timeout = 900 {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.600659] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] config_dir = [] {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.600763] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.600895] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] config_source = [] {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.601045] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] control_exchange = neutron {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.601210] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] core_plugin = ml2 {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.601347] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] debug = True {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.601481] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] default_availability_zones = [] {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.601685] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.601822] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] dhcp_agent_notification = True {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.601954] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] dhcp_agents_per_network = 1 {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.602098] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] dhcp_lease_duration = 86400 {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.602240] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] dhcp_load_type = networks {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.602372] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] dns_domain = openstacklocal {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.602504] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.602633] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] enable_default_route_bfd = False {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.602763] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] enable_default_route_ecmp = False {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.602891] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] enable_dvr = True {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.603032] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] enable_new_agents = True {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.603224] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] enable_services_on_agents_with_admin_state_down = False {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.603321] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] enable_signals = True {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.603450] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] enable_traditional_dhcp = True {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.603574] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] external_dns_driver = None {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.603698] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] filter_validation = True {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.603836] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] global_physnet_mtu = 8950 {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.603968] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] graceful_shutdown_timeout = 60 {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.604178] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] host = cpu-1 {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.604326] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] host_dvr_for_dhcp = True {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.604460] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] http_retries = 3 {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.604596] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] instance_format = [instance: %(uuid)s] {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.604729] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.604862] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] ipam_driver = internal {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.604988] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] ipv6_pd_enabled = False {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.605128] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] l3_ha = False {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.605262] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.605397] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] l3_ha_network_physical_name = {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.605527] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] l3_ha_network_type = {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.605659] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] log_color = False {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.605790] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] log_config_append = None {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.605924] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.606061] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] log_dir = None {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.606194] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] log_file = None {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.606295] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] log_options = True {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.606425] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] log_rotate_interval = 1 {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.606560] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] log_rotate_interval_type = days {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.606693] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] log_rotation_type = none {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.606793] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.606890] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.607041] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.607182] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.607281] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.607414] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] max_dns_nameservers = 5 {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.607542] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] max_header_line = 16384 {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.607670] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] max_l3_agents_per_router = 3 {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.607794] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] max_logfile_count = 30 {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.607920] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] max_logfile_size_mb = 200 {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.608056] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] max_subnet_host_routes = 20 {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.608197] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] my_ip = 10.180.1.21 {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.608328] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] my_ipv6 = ::1 {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.608455] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] network_auto_schedule = True {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.608576] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] network_link_prefix = None {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.608712] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.608849] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] notify_nova_on_port_data_changes = True {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.608980] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] notify_nova_on_port_status_changes = True {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.609129] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] pagination_max_limit = -1 {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.609259] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] publish_errors = False {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.609386] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] rate_limit_burst = 0 {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.609521] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] rate_limit_except_level = CRITICAL {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.609652] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] rate_limit_interval = 0 {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.609779] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] retry_until_window = 30 {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.609905] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] router_distributed = False {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.610043] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] rpc_resources_processing_step = 20 {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.610176] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] rpc_response_max_timeout = 600 {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.610308] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] rpc_response_timeout = 60 {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.610435] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] send_events_interval = 2 {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.610580] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] service_plugins = ['router'] {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.610713] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] setproctitle = on {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.610837] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] shell_completion = None {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.610968] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] state_path = /opt/stack/data/neutron {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.611146] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] syslog_log_facility = LOG_USER {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.611290] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] tcp_keepidle = 600 {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.611426] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] transport_url = **** {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.611555] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] use_journal = False {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.611681] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] use_json = False {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.611806] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] use_ssl = False {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.611929] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] use_stderr = False {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.612078] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] use_syslog = False {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.612208] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] vlan_qinq = None {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.612330] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] vlan_transparent = None {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.612453] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] watch_log_file = False {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.612578] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] wsgi_default_pool_size = 100 {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.612701] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] wsgi_keep_alive = True {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.612832] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.612957] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] wsgi_server_debug = False {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.613163] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] oslo_concurrency.disable_process_locking = False {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.613310] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.613454] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.613586] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.613723] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.613859] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.613991] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.614177] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] profiler.connection_string = messaging:// {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.614322] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] profiler.enabled = False {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.614463] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] profiler.es_doc_type = notification {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.614600] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] profiler.es_scroll_size = 10000 {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.614738] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] profiler.es_scroll_time = 2m {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.614872] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] profiler.filter_error_trace = False {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.615028] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] profiler.hmac_keys = **** {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.615164] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] profiler.sentinel_service_name = mymaster {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.615309] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] profiler.socket_timeout = 0.1 {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.615445] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] profiler.trace_requests = False {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.615577] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] profiler.trace_sqlalchemy = False {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.615719] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] profiler_jaeger.process_tags = {} {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.615850] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] profiler_jaeger.service_name_prefix = None {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.615983] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] profiler_otlp.service_name_prefix = None {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.616144] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] oslo_policy.enforce_new_defaults = True {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.616404] env[65337]: WARNING oslo_config.cfg [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. [ 525.616554] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] oslo_policy.enforce_scope = True {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.616698] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] oslo_policy.policy_default_rule = default {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.616847] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.616988] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.617143] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.617276] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.617404] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.617529] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.617658] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.617796] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] oslo_policy.remote_timeout = 60.0 {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.617943] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.618098] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] agent.extensions = [] {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.618240] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.618376] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] service_providers.service_provider = [] {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.618520] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] QUOTAS.default_quota = -1 {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.618657] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.618789] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] QUOTAS.quota_floatingip = 50 {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.618921] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] QUOTAS.quota_network = 100 {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.619062] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] QUOTAS.quota_port = 500 {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.619196] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] QUOTAS.quota_rbac_policy = 10 {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.619327] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] QUOTAS.quota_router = 10 {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.619454] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] QUOTAS.quota_security_group = 10 {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.619584] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] QUOTAS.quota_security_group_rule = 100 {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.619714] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] QUOTAS.quota_subnet = 100 {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.619841] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] QUOTAS.track_quota_usage = True {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.619985] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.620209] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] privsep.group = None {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.620345] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] privsep.helper_command = None {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.620480] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] privsep.log_daemon_traceback = False {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.620617] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] privsep.logger_name = oslo_privsep.daemon {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.620754] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] privsep.thread_pool_size = 8 {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.620886] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] privsep.user = None {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.621045] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] privsep_dhcp_release.capabilities = [21, 12] {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.621204] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] privsep_dhcp_release.group = None {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.621338] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] privsep_dhcp_release.helper_command = None {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.621472] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] privsep_dhcp_release.log_daemon_traceback = False {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.621608] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.621740] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] privsep_dhcp_release.thread_pool_size = 8 {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.621870] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] privsep_dhcp_release.user = None {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.622017] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.622151] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] privsep_ovs_vsctl.group = None {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.622279] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] privsep_ovs_vsctl.helper_command = None {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.622410] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] privsep_ovs_vsctl.log_daemon_traceback = False {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.622545] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.622678] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] privsep_ovs_vsctl.thread_pool_size = 8 {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.622810] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] privsep_ovs_vsctl.user = None {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.622947] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] privsep_namespace.capabilities = [21] {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.623120] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] privsep_namespace.group = None {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.623257] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] privsep_namespace.helper_command = None {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.623392] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] privsep_namespace.log_daemon_traceback = False {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.623529] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.623665] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] privsep_namespace.thread_pool_size = 8 {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.623797] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] privsep_namespace.user = None {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.623935] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] privsep_conntrack.capabilities = [12] {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.624099] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] privsep_conntrack.group = None {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.624249] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] privsep_conntrack.helper_command = None {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.624385] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] privsep_conntrack.log_daemon_traceback = False {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.624523] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.624657] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] privsep_conntrack.thread_pool_size = 8 {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.624787] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] privsep_conntrack.user = None {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.624927] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] privsep_link.capabilities = [12, 21] {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.625069] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] privsep_link.group = None {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.625202] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] privsep_link.helper_command = None {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.625332] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] privsep_link.log_daemon_traceback = False {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.625465] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] privsep_link.logger_name = oslo_privsep.daemon {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.625596] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] privsep_link.thread_pool_size = 8 {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.625724] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] privsep_link.user = None {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.625872] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] AGENT.agent_id = nsxm-l-01a.corp.local {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.626023] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] AGENT.agent_prometheus_exporter_port = 8000 {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.626168] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] AGENT.continue_on_failed_promotions = False {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.626301] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] AGENT.dscp = None {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.626436] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] AGENT.dscp_inherit = False {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.626575] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] AGENT.force_mp_to_policy = True {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.626704] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] AGENT.locking_coordinator_url = None {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.626835] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] AGENT.log_agent_heartbeats = False {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.626966] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] AGENT.logging_expire = 1 {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.627118] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] AGENT.logging_url = unix:///var/run/redis/socket/redis.sock {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.627257] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] AGENT.max_sg_tags_per_segment_port = 27 {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.627397] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] AGENT.polling_interval = 240 {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.627531] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] AGENT.ports_tag_number_decrease_workaround = True {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.627671] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] AGENT.quitting_rpc_timeout = 120 {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.627812] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] AGENT.report_interval = 30.0 {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.627950] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.628100] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.628243] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] AGENT.rpc_max_records_per_query = 1000 {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.628378] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] AGENT.sync_skew = 60 {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.628529] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] AGENT.synchronization_queue_size = 20 {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.628644] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] AGENT.use_helper_for_ns_read = True {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.628781] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] SECURITYGROUP.enable_ipset = True {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.628922] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] SECURITYGROUP.enable_security_group = True {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.629072] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] SECURITYGROUP.firewall_driver = nsxv3 {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.629219] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] SECURITYGROUP.permitted_ethertypes = [] {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.629353] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] experimental.ipv6_pd_enabled = False {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.629504] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] ml2.extension_drivers = ['port_security'] {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.629635] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] ml2.external_network_type = None {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.629778] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] ml2.mechanism_drivers = ['nsxv3', 'openvswitch', 'logger'] {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.629918] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] ml2.overlay_ip_version = 4 {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.630067] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] ml2.path_mtu = 8950 {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.630210] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] ml2.physical_network_mtus = {} {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.630355] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] ml2.tenant_network_types = ['vlan'] {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.630496] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] ml2.tunnelled_network_rp_name = rp_tunnelled {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.630639] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] ml2.type_drivers = ['vlan'] {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.630782] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] AGENT_CLI.neutron_port_id = [] {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.630912] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] AGENT_CLI.neutron_qos_policy_id = [] {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.631066] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] AGENT_CLI.neutron_security_group_id = [] {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.631232] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] NSXV3.nsxv3_concurrent_requests = 40 {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.631377] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] NSXV3.nsxv3_connection_retry_count = 2 {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.631515] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] NSXV3.nsxv3_connection_retry_sleep = 2 {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.631653] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] NSXV3.nsxv3_default_policy_infrastructure_rules = True {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.631794] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] NSXV3.nsxv3_dfw_connectivity_strategy = NONE {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.631931] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] NSXV3.nsxv3_ip_discovery_switching_profile = nsx-default-ip-discovery-vlan-profile {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.632134] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] NSXV3.nsxv3_login_hostname = nsxt.osci.c.eu-de-1.cloud.sap {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.632283] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] NSXV3.nsxv3_login_password = **** {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.632429] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] NSXV3.nsxv3_login_port = 443 {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.632566] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] NSXV3.nsxv3_login_user = admin {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.632707] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] NSXV3.nsxv3_managed_hosts = [] {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.632849] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] NSXV3.nsxv3_max_records_per_query = 200 {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.632984] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] NSXV3.nsxv3_operation_retry_count = 3 {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.633152] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] NSXV3.nsxv3_operation_retry_sleep = 5 {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.633302] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] NSXV3.nsxv3_realization_timeout = 300 {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.633447] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] NSXV3.nsxv3_remove_orphan_ports_after = 2.0 {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.633587] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] NSXV3.nsxv3_request_timeout = 60 {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.633724] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] NSXV3.nsxv3_requests_per_second = 80 {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.633861] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] NSXV3.nsxv3_requests_per_second_timeout = 7 {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.634010] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] NSXV3.nsxv3_spoof_guard_switching_profile = nsx-default-spoof-guard-vif-profile {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.634183] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] NSXV3.nsxv3_suppress_ssl_warnings = True {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.634326] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] NSXV3.nsxv3_transport_zone_id_cache_time = 86400 {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.634470] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] NSXV3.nsxv3_transport_zone_name = nsx-vlan-transportzone {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.634655] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] vsphere.vsphere_login_hostname = vc-l-01a.corp.local {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.634802] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] vsphere.vsphere_login_password = VMware1! {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.634943] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] vsphere.vsphere_login_username = administrator@vsphere.local {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.635092] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] vsphere.vsphere_suppress_ssl_wornings = True {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.635234] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] nova.auth_section = None {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.635376] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] nova.auth_type = password {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.635515] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.635646] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] nova.certfile = None {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.635778] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] nova.collect_timing = False {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.635920] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] nova.endpoint_type = public {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.636065] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] nova.insecure = False {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.636200] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] nova.keyfile = None {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.636340] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] nova.region_name = RegionOne {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.636475] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] nova.split_loggers = False {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.636605] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] nova.timeout = None {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.636742] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] placement.auth_section = None {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.636883] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] placement.auth_type = password {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.637029] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.637164] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] placement.certfile = None {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.637298] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] placement.collect_timing = False {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.637438] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] placement.endpoint_type = public {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.637569] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] placement.insecure = False {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.637694] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] placement.keyfile = None {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.637821] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] placement.region_name = None {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.637952] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] placement.split_loggers = False {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.638092] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] placement.timeout = None {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.638234] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] ironic.auth_section = None {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.638362] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] ironic.auth_type = None {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.638491] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] ironic.cafile = None {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.638618] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] ironic.certfile = None {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.638751] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] ironic.collect_timing = False {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.638880] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] ironic.connect_retries = None {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.639027] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] ironic.connect_retry_delay = None {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.639154] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] ironic.enable_notifications = False {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.639283] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] ironic.endpoint_override = None {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.639414] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] ironic.insecure = False {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.639544] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] ironic.interface = None {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.639673] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] ironic.keyfile = None {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.639805] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] ironic.max_version = None {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.639934] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] ironic.min_version = None {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.640074] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] ironic.region_name = None {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.640207] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] ironic.retriable_status_codes = None {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.640334] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] ironic.service_name = None {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.640461] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] ironic.service_type = None {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.640593] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] ironic.split_loggers = False {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.640720] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] ironic.status_code_retries = None {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.640845] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] ironic.status_code_retry_delay = None {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.640973] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] ironic.timeout = None {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.641435] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] ironic.valid_interfaces = None {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.641435] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] ironic.version = None {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.641435] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] cli_script.dry_run = False {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.641542] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.641672] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.641808] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.641938] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.642083] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.642218] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.642349] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.642478] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.642609] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.642750] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.642880] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.643027] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.643189] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.643328] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.643461] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.643600] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] oslo_messaging_rabbit.processname = neutron-nsxv3-agent {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.643732] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.643863] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.644007] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.644149] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.644283] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.644415] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.644548] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.644680] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.644809] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.644939] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.645080] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.645213] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.645339] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.645467] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.645598] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] oslo_messaging_rabbit.ssl = False {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.645733] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.645868] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.645997] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.646150] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.646288] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] oslo_messaging_rabbit.ssl_version = {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.646419] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.646559] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] oslo_messaging_notifications.driver = [] {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.646694] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] oslo_messaging_notifications.retry = -1 {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.646838] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.646967] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] oslo_messaging_notifications.transport_url = **** {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.647084] env[65337]: DEBUG oslo_service.backend._eventlet.service [None req-505f3250-709c-4ed5-9146-a2919938a2e0 None None] ******************************************************************************** {{(pid=65337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} [ 525.648165] env[65337]: DEBUG neutron.agent.securitygroups_rpc [None req-f81d39ac-7b08-4c21-a1c2-6484bc6252df None None] Init firewall settings (driver=nsxv3) {{(pid=65337) init_firewall /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:137}} [ 525.649415] env[65337]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.extensions.firewall [None req-f81d39ac-7b08-4c21-a1c2-6484bc6252df None None] Initializing NSXv3SecurityGroupsDriver dummy driver. {{(pid=65337) __init__ /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/extensions/firewall.py:16}} [ 525.649648] env[65337]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-f81d39ac-7b08-4c21-a1c2-6484bc6252df None None] RPC agent_id: nsxm-l-01a.corp.local [ 525.651848] env[65337]: DEBUG dogpile.cache.region [None req-f81d39ac-7b08-4c21-a1c2-6484bc6252df None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 525.651978] env[65337]: DEBUG dogpile.lock [None req-f81d39ac-7b08-4c21-a1c2-6484bc6252df None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 525.652089] env[65337]: DEBUG dogpile.lock [None req-f81d39ac-7b08-4c21-a1c2-6484bc6252df None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 525.652175] env[65337]: DEBUG dogpile.lock [None req-f81d39ac-7b08-4c21-a1c2-6484bc6252df None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 525.652252] env[65337]: DEBUG dogpile.cache.region [None req-f81d39ac-7b08-4c21-a1c2-6484bc6252df None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 525.652336] env[65337]: DEBUG dogpile.lock [None req-f81d39ac-7b08-4c21-a1c2-6484bc6252df None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 525.652465] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f81d39ac-7b08-4c21-a1c2-6484bc6252df None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 525.695478] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-f81d39ac-7b08-4c21-a1c2-6484bc6252df None None] Session token - acquiring [ 525.697082] env[65337]: DEBUG networking_nsxv3.common.locking [None req-f81d39ac-7b08-4c21-a1c2-6484bc6252df None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [, , , , , , , , , , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 525.697260] env[65337]: DEBUG oslo_concurrency.lockutils [None req-f81d39ac-7b08-4c21-a1c2-6484bc6252df None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 525.697365] env[65337]: DEBUG oslo_concurrency.lockutils [None req-f81d39ac-7b08-4c21-a1c2-6484bc6252df None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 525.697825] env[65337]: DEBUG oslo_concurrency.lockutils [None req-f81d39ac-7b08-4c21-a1c2-6484bc6252df None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 525.709843] env[65337]: DEBUG oslo_concurrency.lockutils [None req-f81d39ac-7b08-4c21-a1c2-6484bc6252df None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 525.987755] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-f81d39ac-7b08-4c21-a1c2-6484bc6252df None None] Session token - acquired, connected to NSX-T 4.1.2.0.0.22589037 [ 526.009032] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f81d39ac-7b08-4c21-a1c2-6484bc6252df None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 526.009260] env[65337]: DEBUG dogpile.cache.region [None req-f81d39ac-7b08-4c21-a1c2-6484bc6252df None None] Cache value generated in 0.357 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 526.009308] env[65337]: DEBUG dogpile.lock [None req-f81d39ac-7b08-4c21-a1c2-6484bc6252df None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 526.009409] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f81d39ac-7b08-4c21-a1c2-6484bc6252df None None] Activating Policy API Provider. [ 526.009605] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f81d39ac-7b08-4c21-a1c2-6484bc6252df None None] Looking for the default Infrastructure Rules. [ 526.073765] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f81d39ac-7b08-4c21-a1c2-6484bc6252df None None] Looking for the Default Layer3 Logged Drop Section. [ 526.088333] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-f81d39ac-7b08-4c21-a1c2-6484bc6252df None None] Detected NSX-T (4, 1, 2, 0, 0, 22589037) version. [ 526.088781] env[65337]: DEBUG networking_nsxv3.common.locking [None req-f81d39ac-7b08-4c21-a1c2-6484bc6252df None None] Lock all taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 526.089019] env[65337]: DEBUG oslo_concurrency.lockutils [None req-f81d39ac-7b08-4c21-a1c2-6484bc6252df None None] Acquiring lock "all" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 526.089153] env[65337]: DEBUG oslo_concurrency.lockutils [None req-f81d39ac-7b08-4c21-a1c2-6484bc6252df None None] Acquired lock "all" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 526.089438] env[65337]: DEBUG oslo_concurrency.lockutils [None req-f81d39ac-7b08-4c21-a1c2-6484bc6252df None None] Acquired external semaphore "all" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 526.089764] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-f81d39ac-7b08-4c21-a1c2-6484bc6252df None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 526.604080] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-f81d39ac-7b08-4c21-a1c2-6484bc6252df None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 527.106332] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-f81d39ac-7b08-4c21-a1c2-6484bc6252df None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 527.608276] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-f81d39ac-7b08-4c21-a1c2-6484bc6252df None None] Inventory metadata is going to be refreshed. [ 527.608729] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f81d39ac-7b08-4c21-a1c2-6484bc6252df None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 528.429017] env[65337]: DEBUG networking_nsxv3.common.locking [None req-f81d39ac-7b08-4c21-a1c2-6484bc6252df None None] Lock Segment taken with stack trace [, , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 528.429371] env[65337]: DEBUG oslo_concurrency.lockutils [None req-f81d39ac-7b08-4c21-a1c2-6484bc6252df None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 528.429371] env[65337]: DEBUG oslo_concurrency.lockutils [None req-f81d39ac-7b08-4c21-a1c2-6484bc6252df None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 528.429644] env[65337]: DEBUG oslo_concurrency.lockutils [None req-f81d39ac-7b08-4c21-a1c2-6484bc6252df None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 528.441023] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [None req-f81d39ac-7b08-4c21-a1c2-6484bc6252df None None] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 528.442026] env[65337]: DEBUG oslo_concurrency.lockutils [None req-f81d39ac-7b08-4c21-a1c2-6484bc6252df None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 528.442854] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f81d39ac-7b08-4c21-a1c2-6484bc6252df None None] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 528.460179] env[65337]: DEBUG networking_nsxv3.common.locking [None req-f81d39ac-7b08-4c21-a1c2-6484bc6252df None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 528.460489] env[65337]: DEBUG oslo_concurrency.lockutils [None req-f81d39ac-7b08-4c21-a1c2-6484bc6252df None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 528.460489] env[65337]: DEBUG oslo_concurrency.lockutils [None req-f81d39ac-7b08-4c21-a1c2-6484bc6252df None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 528.460729] env[65337]: DEBUG oslo_concurrency.lockutils [None req-f81d39ac-7b08-4c21-a1c2-6484bc6252df None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 528.461022] env[65337]: DEBUG oslo_concurrency.lockutils [None req-f81d39ac-7b08-4c21-a1c2-6484bc6252df None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 528.461022] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f81d39ac-7b08-4c21-a1c2-6484bc6252df None None] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 528.461310] env[65337]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f81d39ac-7b08-4c21-a1c2-6484bc6252df None None] Outdated resources of Type:SegmentPort Are:set() {{(pid=65337) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 528.461445] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f81d39ac-7b08-4c21-a1c2-6484bc6252df None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 528.480902] env[65337]: DEBUG networking_nsxv3.common.locking [None req-f81d39ac-7b08-4c21-a1c2-6484bc6252df None None] Lock Security Group (Rules) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 528.481199] env[65337]: DEBUG oslo_concurrency.lockutils [None req-f81d39ac-7b08-4c21-a1c2-6484bc6252df None None] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 528.481199] env[65337]: DEBUG oslo_concurrency.lockutils [None req-f81d39ac-7b08-4c21-a1c2-6484bc6252df None None] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 528.481491] env[65337]: DEBUG oslo_concurrency.lockutils [None req-f81d39ac-7b08-4c21-a1c2-6484bc6252df None None] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 528.481665] env[65337]: DEBUG oslo_concurrency.lockutils [None req-f81d39ac-7b08-4c21-a1c2-6484bc6252df None None] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 528.481804] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f81d39ac-7b08-4c21-a1c2-6484bc6252df None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 528.502809] env[65337]: DEBUG networking_nsxv3.common.locking [None req-f81d39ac-7b08-4c21-a1c2-6484bc6252df None None] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 528.503558] env[65337]: DEBUG oslo_concurrency.lockutils [None req-f81d39ac-7b08-4c21-a1c2-6484bc6252df None None] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 528.503558] env[65337]: DEBUG oslo_concurrency.lockutils [None req-f81d39ac-7b08-4c21-a1c2-6484bc6252df None None] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 528.503558] env[65337]: DEBUG oslo_concurrency.lockutils [None req-f81d39ac-7b08-4c21-a1c2-6484bc6252df None None] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 528.503796] env[65337]: DEBUG oslo_concurrency.lockutils [None req-f81d39ac-7b08-4c21-a1c2-6484bc6252df None None] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 528.503796] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f81d39ac-7b08-4c21-a1c2-6484bc6252df None None] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 528.524929] env[65337]: DEBUG networking_nsxv3.common.locking [None req-f81d39ac-7b08-4c21-a1c2-6484bc6252df None None] Lock Address Group taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 528.525239] env[65337]: DEBUG oslo_concurrency.lockutils [None req-f81d39ac-7b08-4c21-a1c2-6484bc6252df None None] Acquiring lock "Address Group" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 528.525239] env[65337]: DEBUG oslo_concurrency.lockutils [None req-f81d39ac-7b08-4c21-a1c2-6484bc6252df None None] Acquired lock "Address Group" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 528.525520] env[65337]: DEBUG oslo_concurrency.lockutils [None req-f81d39ac-7b08-4c21-a1c2-6484bc6252df None None] Acquired external semaphore "Address Group" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 528.525649] env[65337]: DEBUG oslo_concurrency.lockutils [None req-f81d39ac-7b08-4c21-a1c2-6484bc6252df None None] Releasing lock "Address Group" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 528.525791] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f81d39ac-7b08-4c21-a1c2-6484bc6252df None None] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 528.525891] env[65337]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f81d39ac-7b08-4c21-a1c2-6484bc6252df None None] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65337) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 528.525993] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f81d39ac-7b08-4c21-a1c2-6484bc6252df None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 528.544561] env[65337]: DEBUG networking_nsxv3.common.locking [None req-f81d39ac-7b08-4c21-a1c2-6484bc6252df None None] Lock Segment QoS taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 528.544806] env[65337]: DEBUG oslo_concurrency.lockutils [None req-f81d39ac-7b08-4c21-a1c2-6484bc6252df None None] Acquiring lock "Segment QoS" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 528.544887] env[65337]: DEBUG oslo_concurrency.lockutils [None req-f81d39ac-7b08-4c21-a1c2-6484bc6252df None None] Acquired lock "Segment QoS" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 528.545186] env[65337]: DEBUG oslo_concurrency.lockutils [None req-f81d39ac-7b08-4c21-a1c2-6484bc6252df None None] Acquired external semaphore "Segment QoS" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 528.545315] env[65337]: DEBUG oslo_concurrency.lockutils [None req-f81d39ac-7b08-4c21-a1c2-6484bc6252df None None] Releasing lock "Segment QoS" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 528.545458] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f81d39ac-7b08-4c21-a1c2-6484bc6252df None None] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 528.545557] env[65337]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f81d39ac-7b08-4c21-a1c2-6484bc6252df None None] Outdated resources of Type:Segment QoS Are:set() {{(pid=65337) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 528.545670] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f81d39ac-7b08-4c21-a1c2-6484bc6252df None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 528.566826] env[65337]: DEBUG networking_nsxv3.common.locking [None req-f81d39ac-7b08-4c21-a1c2-6484bc6252df None None] Lock Security Group (Members) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 528.567116] env[65337]: DEBUG oslo_concurrency.lockutils [None req-f81d39ac-7b08-4c21-a1c2-6484bc6252df None None] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 528.567116] env[65337]: DEBUG oslo_concurrency.lockutils [None req-f81d39ac-7b08-4c21-a1c2-6484bc6252df None None] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 528.567432] env[65337]: DEBUG oslo_concurrency.lockutils [None req-f81d39ac-7b08-4c21-a1c2-6484bc6252df None None] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 528.567579] env[65337]: DEBUG oslo_concurrency.lockutils [None req-f81d39ac-7b08-4c21-a1c2-6484bc6252df None None] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 528.567725] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f81d39ac-7b08-4c21-a1c2-6484bc6252df None None] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 528.567826] env[65337]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f81d39ac-7b08-4c21-a1c2-6484bc6252df None None] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65337) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 528.567924] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-f81d39ac-7b08-4c21-a1c2-6484bc6252df None None] Inventory metadata have been refreshed. [ 528.568029] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-f81d39ac-7b08-4c21-a1c2-6484bc6252df None None] Dryrun:True. Metadata refresh completed. [ 528.568146] env[65337]: DEBUG oslo_concurrency.lockutils [None req-f81d39ac-7b08-4c21-a1c2-6484bc6252df None None] Releasing lock "all" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 528.569764] env[65337]: INFO neutron.agent.agent_extensions_manager [None req-f81d39ac-7b08-4c21-a1c2-6484bc6252df None None] Loaded agent extensions: [] [ 528.570636] env[65337]: DEBUG neutron_lib.callbacks.manager [None req-f81d39ac-7b08-4c21-a1c2-6484bc6252df None None] Publish callbacks [] for NSXv3 Agent (None), after_init {{(pid=65337) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} [ 528.620700] env[65337]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-f81d39ac-7b08-4c21-a1c2-6484bc6252df None None] NSXv3 Agent Agent RPC Daemon Started! [ 528.621127] env[65337]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-f81d39ac-7b08-4c21-a1c2-6484bc6252df None None] NSXv3 Agent Agent loop - iteration:0 started [ 528.621127] env[65337]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-f81d39ac-7b08-4c21-a1c2-6484bc6252df None None] NSXv3 Agent Agent out of sync with plugin! [ 533.571927] env[65337]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 533.571927] env[65337]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 538.573221] env[65337]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 538.573633] env[65337]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 543.261836] env[65337]: INFO networking_nsxv3.common.synchronization [None req-6787138f-5a17-4243-a6b4-089b5c55c9f1 demo admin] Enqueued Resource ID: 2470c92d-6d96-4e18-88d7-521bd597c850 with Priority: HIGHEST for action security_group_rules [ 543.262337] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2470c92d-6d96-4e18-88d7-521bd597c850 with Priority: HIGHEST for action security_group_rules [ 543.262868] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2470c92d-6d96-4e18-88d7-521bd597c850 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.263044] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2470c92d-6d96-4e18-88d7-521bd597c850" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 543.263271] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2470c92d-6d96-4e18-88d7-521bd597c850" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 543.263713] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2470c92d-6d96-4e18-88d7-521bd597c850" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 543.263843] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2470c92d-6d96-4e18-88d7-521bd597c850',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 543.785474] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.785474] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 543.785474] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 543.785474] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 543.785474] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 543.785474] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2470c92d-6d96-4e18-88d7-521bd597c850 already deleted. [ 543.785474] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2470c92d-6d96-4e18-88d7-521bd597c850" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 548.263540] env[65337]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 548.263975] env[65337]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 553.265080] env[65337]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 553.265080] env[65337]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 558.265862] env[65337]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 558.265862] env[65337]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 563.267024] env[65337]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 563.267024] env[65337]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 568.267697] env[65337]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 568.267998] env[65337]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 571.382262] env[65337]: INFO networking_nsxv3.common.synchronization [None req-04c76976-47c8-41ae-b7db-ba4a00302c67 None None] Enqueued Resource ID: 17eada7d-c93a-41b9-9023-1b7c53dd4ad6 with Priority: HIGHEST for action port [ 571.383412] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17eada7d-c93a-41b9-9023-1b7c53dd4ad6 with Priority: HIGHEST for action port [ 571.384218] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-17eada7d-c93a-41b9-9023-1b7c53dd4ad6 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 571.384322] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-17eada7d-c93a-41b9-9023-1b7c53dd4ad6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 571.384393] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-17eada7d-c93a-41b9-9023-1b7c53dd4ad6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 571.384635] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-17eada7d-c93a-41b9-9023-1b7c53dd4ad6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 571.384724] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('17eada7d-c93a-41b9-9023-1b7c53dd4ad6',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 571.887385] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 17eada7d-c93a-41b9-9023-1b7c53dd4ad6 [ 571.888025] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 571.888025] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 571.888025] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 571.888025] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 571.888279] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 571.888279] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:17eada7d-c93a-41b9-9023-1b7c53dd4ad6 already deleted. [ 571.888279] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-17eada7d-c93a-41b9-9023-1b7c53dd4ad6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.131665] env[65337]: INFO networking_nsxv3.common.synchronization [None req-8fddcadb-34d6-44f3-9e89-07999448a0b0 None None] Enqueued Resource ID: 69396114-7661-416e-9491-6a215494fcbe with Priority: HIGHEST for action port [ 573.132230] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69396114-7661-416e-9491-6a215494fcbe with Priority: HIGHEST for action port [ 573.132533] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-69396114-7661-416e-9491-6a215494fcbe taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.132670] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-69396114-7661-416e-9491-6a215494fcbe" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.132932] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-69396114-7661-416e-9491-6a215494fcbe" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.133022] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-69396114-7661-416e-9491-6a215494fcbe" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.133162] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('69396114-7661-416e-9491-6a215494fcbe',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 573.636046] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 69396114-7661-416e-9491-6a215494fcbe [ 573.636186] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.636337] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.636409] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.636627] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.636981] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.636981] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:69396114-7661-416e-9491-6a215494fcbe already deleted. [ 573.636981] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-69396114-7661-416e-9491-6a215494fcbe" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 575.577351] env[65337]: INFO networking_nsxv3.common.synchronization [None req-14279910-2462-4c7d-9541-5ec7b213b0be None None] Enqueued Resource ID: b89090aa-ec9c-4a76-a981-ea23a320eec7 with Priority: HIGHEST for action port [ 575.577953] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b89090aa-ec9c-4a76-a981-ea23a320eec7 with Priority: HIGHEST for action port [ 575.578276] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-b89090aa-ec9c-4a76-a981-ea23a320eec7 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.578399] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b89090aa-ec9c-4a76-a981-ea23a320eec7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.578463] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b89090aa-ec9c-4a76-a981-ea23a320eec7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.578708] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b89090aa-ec9c-4a76-a981-ea23a320eec7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.578789] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b89090aa-ec9c-4a76-a981-ea23a320eec7',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 575.716146] env[65337]: INFO networking_nsxv3.common.synchronization [None req-dc458e3f-9d7c-42a0-892a-c14781452589 None None] Enqueued Resource ID: f8bd5444-30ec-4047-8560-3b166413e28a with Priority: HIGHEST for action port [ 575.716146] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8bd5444-30ec-4047-8560-3b166413e28a with Priority: HIGHEST for action port [ 575.716146] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-f8bd5444-30ec-4047-8560-3b166413e28a taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.716146] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f8bd5444-30ec-4047-8560-3b166413e28a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.716146] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f8bd5444-30ec-4047-8560-3b166413e28a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.716146] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f8bd5444-30ec-4047-8560-3b166413e28a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.716971] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f8bd5444-30ec-4047-8560-3b166413e28a',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 576.082414] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b89090aa-ec9c-4a76-a981-ea23a320eec7 [ 576.082654] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.082784] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.082849] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.083346] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.083494] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.083570] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b89090aa-ec9c-4a76-a981-ea23a320eec7 already deleted. [ 576.084832] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b89090aa-ec9c-4a76-a981-ea23a320eec7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.223129] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f8bd5444-30ec-4047-8560-3b166413e28a [ 576.223129] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.223129] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.223129] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.223129] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.223129] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.223129] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f8bd5444-30ec-4047-8560-3b166413e28a already deleted. [ 576.223129] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f8bd5444-30ec-4047-8560-3b166413e28a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.407085] env[65337]: INFO networking_nsxv3.common.synchronization [None req-b05f1d48-19e7-4c29-a44f-7ed68bf4a46c None None] Enqueued Resource ID: 3c3a17a7-3dcc-4ff6-b7d7-989e81e2e204 with Priority: HIGHEST for action port [ 576.407085] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c3a17a7-3dcc-4ff6-b7d7-989e81e2e204 with Priority: HIGHEST for action port [ 576.407085] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-3c3a17a7-3dcc-4ff6-b7d7-989e81e2e204 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.407085] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3c3a17a7-3dcc-4ff6-b7d7-989e81e2e204" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.407085] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3c3a17a7-3dcc-4ff6-b7d7-989e81e2e204" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.407085] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3c3a17a7-3dcc-4ff6-b7d7-989e81e2e204" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.407085] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3c3a17a7-3dcc-4ff6-b7d7-989e81e2e204',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 576.910772] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3c3a17a7-3dcc-4ff6-b7d7-989e81e2e204 [ 576.910772] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.910772] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.911136] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.912657] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.912736] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.912806] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3c3a17a7-3dcc-4ff6-b7d7-989e81e2e204 already deleted. [ 576.912890] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3c3a17a7-3dcc-4ff6-b7d7-989e81e2e204" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.481681] env[65337]: INFO networking_nsxv3.common.synchronization [None req-1be2c66e-414c-49d6-98ff-2adc7fed6b32 None None] Enqueued Resource ID: ec0aa21d-20f9-4b56-8661-c012cffb814b with Priority: HIGHEST for action port [ 577.482042] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec0aa21d-20f9-4b56-8661-c012cffb814b with Priority: HIGHEST for action port [ 577.482301] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-ec0aa21d-20f9-4b56-8661-c012cffb814b taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.482426] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ec0aa21d-20f9-4b56-8661-c012cffb814b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.482508] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ec0aa21d-20f9-4b56-8661-c012cffb814b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.482767] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ec0aa21d-20f9-4b56-8661-c012cffb814b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.482852] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ec0aa21d-20f9-4b56-8661-c012cffb814b',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 577.987068] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ec0aa21d-20f9-4b56-8661-c012cffb814b [ 577.988826] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.988826] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.988826] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.988826] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.988826] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.988826] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ec0aa21d-20f9-4b56-8661-c012cffb814b already deleted. [ 577.988826] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ec0aa21d-20f9-4b56-8661-c012cffb814b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.574122] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.574122] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.574122] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.574122] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.574387] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 578.592449] env[65337]: INFO networking_nsxv3.common.synchronization [None req-11e04016-5b77-4018-8da8-a63f1c687d04 None None] Enqueued Resource ID: 7edd0ad8-6f54-4b3b-ab58-cf1cf6d70b12 with Priority: HIGHEST for action port [ 578.593612] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7edd0ad8-6f54-4b3b-ab58-cf1cf6d70b12 with Priority: HIGHEST for action port [ 578.594977] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-7edd0ad8-6f54-4b3b-ab58-cf1cf6d70b12 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.595141] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7edd0ad8-6f54-4b3b-ab58-cf1cf6d70b12" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.595382] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7edd0ad8-6f54-4b3b-ab58-cf1cf6d70b12" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.597573] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7edd0ad8-6f54-4b3b-ab58-cf1cf6d70b12" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.597573] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7edd0ad8-6f54-4b3b-ab58-cf1cf6d70b12',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 579.079188] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 579.100591] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7edd0ad8-6f54-4b3b-ab58-cf1cf6d70b12 [ 579.100591] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.100591] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.100591] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.100591] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.100591] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.100591] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7edd0ad8-6f54-4b3b-ab58-cf1cf6d70b12 already deleted. [ 579.100591] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7edd0ad8-6f54-4b3b-ab58-cf1cf6d70b12" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.451813] env[65337]: INFO networking_nsxv3.common.synchronization [None req-acd8c210-991f-4dc9-b62c-8e60626861fe None None] Enqueued Resource ID: 6fb2ffe9-99be-4eaf-9125-574f19b81735 with Priority: HIGHEST for action port [ 579.452365] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fb2ffe9-99be-4eaf-9125-574f19b81735 with Priority: HIGHEST for action port [ 579.452671] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-6fb2ffe9-99be-4eaf-9125-574f19b81735 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.452827] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6fb2ffe9-99be-4eaf-9125-574f19b81735" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.452879] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6fb2ffe9-99be-4eaf-9125-574f19b81735" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.456428] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6fb2ffe9-99be-4eaf-9125-574f19b81735" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.456508] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6fb2ffe9-99be-4eaf-9125-574f19b81735',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 579.570264] env[65337]: INFO networking_nsxv3.common.synchronization [None req-3916e5e8-a2ce-4fd7-9185-ce658ba7d60c None None] Enqueued Resource ID: 9b1013e4-97ea-4655-8193-0dc65b9cbdb0 with Priority: HIGHEST for action port [ 579.570500] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b1013e4-97ea-4655-8193-0dc65b9cbdb0 with Priority: HIGHEST for action port [ 579.571078] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-9b1013e4-97ea-4655-8193-0dc65b9cbdb0 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.572159] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9b1013e4-97ea-4655-8193-0dc65b9cbdb0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.572240] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9b1013e4-97ea-4655-8193-0dc65b9cbdb0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.572750] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9b1013e4-97ea-4655-8193-0dc65b9cbdb0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.572874] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9b1013e4-97ea-4655-8193-0dc65b9cbdb0',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 579.584121] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 579.958602] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6fb2ffe9-99be-4eaf-9125-574f19b81735 [ 579.958829] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.959181] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.959181] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.959310] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.959352] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.960056] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6fb2ffe9-99be-4eaf-9125-574f19b81735 already deleted. [ 579.960376] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6fb2ffe9-99be-4eaf-9125-574f19b81735" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.076080] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9b1013e4-97ea-4655-8193-0dc65b9cbdb0 [ 580.076327] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.076907] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.076907] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.076907] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.076907] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.076907] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9b1013e4-97ea-4655-8193-0dc65b9cbdb0 already deleted. [ 580.077132] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9b1013e4-97ea-4655-8193-0dc65b9cbdb0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.089355] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 580.089355] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 580.127264] env[65337]: INFO networking_nsxv3.common.synchronization [req-f353258f-129e-4dc5-8648-444066b336cd req-10ddf07c-5949-44dc-92ea-b95d18574250 tempest-SecurityGroupRulesNegativeTestJSON-1502376126 tempest-SecurityGroupRulesNegativeTestJSON-1502376126-project-member] Enqueued Resource ID: f1f34466-ff97-435d-a02c-66b2c3da216c with Priority: HIGHEST for action security_group_rules [ 580.127890] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1f34466-ff97-435d-a02c-66b2c3da216c with Priority: HIGHEST for action security_group_rules [ 580.128162] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f1f34466-ff97-435d-a02c-66b2c3da216c taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.128260] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f1f34466-ff97-435d-a02c-66b2c3da216c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.128419] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f1f34466-ff97-435d-a02c-66b2c3da216c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.128607] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f1f34466-ff97-435d-a02c-66b2c3da216c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.128607] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f1f34466-ff97-435d-a02c-66b2c3da216c',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 580.537798] env[65337]: INFO networking_nsxv3.common.synchronization [None req-6542b709-b68d-4e2f-b296-eeb92425a625 None None] Enqueued Resource ID: 5cf2aeef-4960-46b1-af94-f4bfdf0a6739 with Priority: HIGHEST for action port [ 580.538388] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5cf2aeef-4960-46b1-af94-f4bfdf0a6739 with Priority: HIGHEST for action port [ 580.538699] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-5cf2aeef-4960-46b1-af94-f4bfdf0a6739 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.538825] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5cf2aeef-4960-46b1-af94-f4bfdf0a6739" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.538893] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5cf2aeef-4960-46b1-af94-f4bfdf0a6739" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.541252] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5cf2aeef-4960-46b1-af94-f4bfdf0a6739" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.541355] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5cf2aeef-4960-46b1-af94-f4bfdf0a6739',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 580.663151] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.663373] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.663678] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.665206] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.665330] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.665458] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f1f34466-ff97-435d-a02c-66b2c3da216c already deleted. [ 580.665527] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f1f34466-ff97-435d-a02c-66b2c3da216c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.933270] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.933483] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.933556] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.933765] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.951624] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 580.953377] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.954714] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 580.975712] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.975712] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.975712] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.976016] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.976063] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.976271] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 580.976271] env[65337]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65337) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 580.976354] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 581.001683] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.002054] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.002054] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.002144] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.003176] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.003176] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 581.026283] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.026661] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.026821] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.027561] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.027561] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.027561] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 581.044201] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5cf2aeef-4960-46b1-af94-f4bfdf0a6739 [ 581.045584] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.045584] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.045584] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.045584] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.045584] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.045584] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5cf2aeef-4960-46b1-af94-f4bfdf0a6739 already deleted. [ 581.045584] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5cf2aeef-4960-46b1-af94-f4bfdf0a6739" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.053272] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.053272] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.053272] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.053272] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.053272] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.053272] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 581.053272] env[65337]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65337) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 581.053272] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 581.073193] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.074078] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.074233] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.074799] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.074957] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.075097] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 581.075174] env[65337]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65337) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 581.075248] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 581.100041] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.100366] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.100366] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.100775] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.100775] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.100775] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 581.100775] env[65337]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65337) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 581.100923] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 581.100923] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 581.101076] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 581.101076] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 581.101179] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 581.101486] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 581.101601] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 581.101601] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 581.126627] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.127468] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.127468] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.127468] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.127468] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.127468] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 581.147464] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.147601] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.147601] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.147807] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.147905] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.179764] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.780922] env[65337]: INFO networking_nsxv3.common.synchronization [None req-23eff7b3-6538-4e57-ad3f-b5370a7a9367 None None] Enqueued Resource ID: 7697ef06-f054-4a03-b3a8-9cf06b145296 with Priority: HIGHEST for action port [ 581.780922] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7697ef06-f054-4a03-b3a8-9cf06b145296 with Priority: HIGHEST for action port [ 581.781375] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-7697ef06-f054-4a03-b3a8-9cf06b145296 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.781499] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7697ef06-f054-4a03-b3a8-9cf06b145296" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.781558] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7697ef06-f054-4a03-b3a8-9cf06b145296" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.781801] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7697ef06-f054-4a03-b3a8-9cf06b145296" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.781875] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7697ef06-f054-4a03-b3a8-9cf06b145296',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.286783] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7697ef06-f054-4a03-b3a8-9cf06b145296 [ 582.287030] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.287141] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.287229] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.287539] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.287860] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.287965] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7697ef06-f054-4a03-b3a8-9cf06b145296 already deleted. [ 582.288070] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7697ef06-f054-4a03-b3a8-9cf06b145296" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.088449] env[65337]: INFO networking_nsxv3.common.synchronization [None req-c6107556-06c0-487c-a293-de9dc4b7d4c9 None None] Enqueued Resource ID: de4e106f-d1c1-4d6c-9991-adc4034b85cf with Priority: HIGHEST for action port [ 583.088449] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de4e106f-d1c1-4d6c-9991-adc4034b85cf with Priority: HIGHEST for action port [ 583.088624] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-de4e106f-d1c1-4d6c-9991-adc4034b85cf taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.088804] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-de4e106f-d1c1-4d6c-9991-adc4034b85cf" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.088804] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-de4e106f-d1c1-4d6c-9991-adc4034b85cf" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.091923] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-de4e106f-d1c1-4d6c-9991-adc4034b85cf" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.091923] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('de4e106f-d1c1-4d6c-9991-adc4034b85cf',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 583.410761] env[65337]: INFO networking_nsxv3.common.synchronization [None req-49db3430-8424-42c9-9f49-3ba86ea91ab3 None None] Enqueued Resource ID: 649be400-e619-4f62-a2da-e75b8e183a29 with Priority: HIGHEST for action port [ 583.411261] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 649be400-e619-4f62-a2da-e75b8e183a29 with Priority: HIGHEST for action port [ 583.411653] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-649be400-e619-4f62-a2da-e75b8e183a29 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.411882] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-649be400-e619-4f62-a2da-e75b8e183a29" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.411945] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-649be400-e619-4f62-a2da-e75b8e183a29" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.413436] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-649be400-e619-4f62-a2da-e75b8e183a29" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.413508] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('649be400-e619-4f62-a2da-e75b8e183a29',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 583.594332] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port de4e106f-d1c1-4d6c-9991-adc4034b85cf [ 583.594332] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.594572] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.594572] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.594862] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.594862] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.594966] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:de4e106f-d1c1-4d6c-9991-adc4034b85cf already deleted. [ 583.594966] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-de4e106f-d1c1-4d6c-9991-adc4034b85cf" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.915991] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 649be400-e619-4f62-a2da-e75b8e183a29 [ 583.916459] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.916459] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.916459] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.916685] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.916750] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.916842] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:649be400-e619-4f62-a2da-e75b8e183a29 already deleted. [ 583.916922] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-649be400-e619-4f62-a2da-e75b8e183a29" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.262671] env[65337]: INFO networking_nsxv3.common.synchronization [None req-1ea5ee52-d6ee-4cef-9eef-845e5b5ac2d0 None None] Enqueued Resource ID: fe61c488-03f7-4382-a4e1-643bd228f3b7 with Priority: HIGHEST for action port [ 584.262671] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe61c488-03f7-4382-a4e1-643bd228f3b7 with Priority: HIGHEST for action port [ 584.263017] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-fe61c488-03f7-4382-a4e1-643bd228f3b7 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.263142] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fe61c488-03f7-4382-a4e1-643bd228f3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.263393] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fe61c488-03f7-4382-a4e1-643bd228f3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.263883] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fe61c488-03f7-4382-a4e1-643bd228f3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.264026] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe61c488-03f7-4382-a4e1-643bd228f3b7',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.770985] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fe61c488-03f7-4382-a4e1-643bd228f3b7 [ 584.770985] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.770985] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.770985] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.770985] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.770985] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.770985] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fe61c488-03f7-4382-a4e1-643bd228f3b7 already deleted. [ 584.770985] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fe61c488-03f7-4382-a4e1-643bd228f3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.953811] env[65337]: INFO networking_nsxv3.common.synchronization [req-184752bf-efa6-4090-8f7c-23dcae93320a req-6e238d99-62a4-460f-938b-99cd05c1b2c4 tempest-TenantUsagesTestJSON-1174146655 tempest-TenantUsagesTestJSON-1174146655-project-member] Enqueued Resource ID: 114a6017-3f79-438c-9593-053232b9f176 with Priority: HIGHEST for action security_group_members [ 584.954099] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 114a6017-3f79-438c-9593-053232b9f176 with Priority: HIGHEST for action security_group_members [ 584.954415] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-114a6017-3f79-438c-9593-053232b9f176 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.954566] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-114a6017-3f79-438c-9593-053232b9f176" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.954780] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-114a6017-3f79-438c-9593-053232b9f176" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.954845] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-114a6017-3f79-438c-9593-053232b9f176" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.955012] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.956186] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.956262] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.956435] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.956529] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.956623] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('114a6017-3f79-438c-9593-053232b9f176',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.462015] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.462015] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.462015] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.462015] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.462015] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.462015] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.462015] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.462015] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.462015] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.462015] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.462015] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 114a6017-3f79-438c-9593-053232b9f176 already deleted. [ 585.462015] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-114a6017-3f79-438c-9593-053232b9f176" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.671569] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock network-292 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.671815] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "network-292" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.671935] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "network-292" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.672222] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "network-292" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.672514] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.672673] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.672785] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.673017] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.673150] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.673597] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 585.673597] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 585.673690] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 585.673833] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 585.673900] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 585.674008] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 585.674138] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 585.693806] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 585.694032] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 585.694183] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 585.694372] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "network-292" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.694724] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock port-e4d2e5ae-c18a-4e93-9716-0e746372aede taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.694915] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "port-e4d2e5ae-c18a-4e93-9716-0e746372aede" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.695750] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "port-e4d2e5ae-c18a-4e93-9716-0e746372aede" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.696166] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "port-e4d2e5ae-c18a-4e93-9716-0e746372aede" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.696318] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e4d2e5ae-c18a-4e93-9716-0e746372aede',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.054057] env[65337]: INFO networking_nsxv3.common.synchronization [None req-1c9bfe54-30fa-41ff-9821-ea36d75b3ac0 None None] Enqueued Resource ID: fc9a8787-a244-45a5-9714-60dafb6994ec with Priority: HIGHEST for action port [ 586.054998] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc9a8787-a244-45a5-9714-60dafb6994ec with Priority: HIGHEST for action port [ 586.054998] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-fc9a8787-a244-45a5-9714-60dafb6994ec taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.057851] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fc9a8787-a244-45a5-9714-60dafb6994ec" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.057851] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fc9a8787-a244-45a5-9714-60dafb6994ec" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.057851] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fc9a8787-a244-45a5-9714-60dafb6994ec" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.057851] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fc9a8787-a244-45a5-9714-60dafb6994ec',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.200666] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.200970] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.201169] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.201453] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.201687] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.201755] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Segment Port e4d2e5ae-c18a-4e93-9716-0e746372aede not found, creating... [ 586.202012] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.202272] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.202272] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.202561] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.202724] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.203114] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.203311] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.203491] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.203731] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.203889] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.204061] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Resource: SegmentPort with ID: e4d2e5ae-c18a-4e93-9716-0e746372aede is going to be created. [ 586.228327] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.228528] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.228643] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.228900] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.229232] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.229457] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "port-e4d2e5ae-c18a-4e93-9716-0e746372aede" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.558207] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fc9a8787-a244-45a5-9714-60dafb6994ec [ 586.558445] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.558588] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.558657] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.558868] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.558961] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.559067] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fc9a8787-a244-45a5-9714-60dafb6994ec already deleted. [ 586.559173] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fc9a8787-a244-45a5-9714-60dafb6994ec" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.698332] env[65337]: INFO networking_nsxv3.common.synchronization [req-55c393cc-ed56-47d7-a2f6-41b8fbd5dd12 req-10139388-510e-4cf1-b74e-3ddb198c1e09 tempest-SecurityGroupRulesNegativeTestJSON-1502376126 tempest-SecurityGroupRulesNegativeTestJSON-1502376126-project-member] Enqueued Resource ID: f1f34466-ff97-435d-a02c-66b2c3da216c with Priority: HIGHEST for action security_group_rules [ 586.698875] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1f34466-ff97-435d-a02c-66b2c3da216c with Priority: HIGHEST for action security_group_rules [ 586.699185] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f1f34466-ff97-435d-a02c-66b2c3da216c taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.699307] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f1f34466-ff97-435d-a02c-66b2c3da216c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.699372] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f1f34466-ff97-435d-a02c-66b2c3da216c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.700675] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f1f34466-ff97-435d-a02c-66b2c3da216c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.700764] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f1f34466-ff97-435d-a02c-66b2c3da216c',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.996140] env[65337]: INFO networking_nsxv3.common.synchronization [req-184752bf-efa6-4090-8f7c-23dcae93320a req-4b8984a7-e558-43de-803a-3d294f7ea91a service nova] Enqueued Resource ID: 114a6017-3f79-438c-9593-053232b9f176 with Priority: HIGHEST for action security_group_rules [ 586.996317] env[65337]: INFO networking_nsxv3.common.synchronization [req-184752bf-efa6-4090-8f7c-23dcae93320a req-4b8984a7-e558-43de-803a-3d294f7ea91a service nova] Enqueued Resource ID: 114a6017-3f79-438c-9593-053232b9f176 with Priority: HIGHEST for action security_group_members [ 586.996467] env[65337]: INFO networking_nsxv3.common.synchronization [req-184752bf-efa6-4090-8f7c-23dcae93320a req-4b8984a7-e558-43de-803a-3d294f7ea91a service nova] Enqueued Resource ID: e4d2e5ae-c18a-4e93-9716-0e746372aede with Priority: HIGHEST for action port [ 586.996726] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 114a6017-3f79-438c-9593-053232b9f176 with Priority: HIGHEST for action security_group_rules [ 586.996906] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 114a6017-3f79-438c-9593-053232b9f176 with Priority: HIGHEST for action security_group_members [ 586.996966] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4d2e5ae-c18a-4e93-9716-0e746372aede with Priority: HIGHEST for action port [ 586.997498] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-114a6017-3f79-438c-9593-053232b9f176 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.997622] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-114a6017-3f79-438c-9593-053232b9f176" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.997683] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-114a6017-3f79-438c-9593-053232b9f176" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.997935] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-114a6017-3f79-438c-9593-053232b9f176" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.002129] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('114a6017-3f79-438c-9593-053232b9f176',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.003053] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-114a6017-3f79-438c-9593-053232b9f176 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.003183] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-114a6017-3f79-438c-9593-053232b9f176" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.003249] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-114a6017-3f79-438c-9593-053232b9f176" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.003485] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-114a6017-3f79-438c-9593-053232b9f176" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.003843] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.003843] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.003843] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.004036] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.004036] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.004181] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('114a6017-3f79-438c-9593-053232b9f176',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.005150] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-e4d2e5ae-c18a-4e93-9716-0e746372aede taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.005273] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e4d2e5ae-c18a-4e93-9716-0e746372aede" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.005336] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e4d2e5ae-c18a-4e93-9716-0e746372aede" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.005470] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e4d2e5ae-c18a-4e93-9716-0e746372aede" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.005544] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e4d2e5ae-c18a-4e93-9716-0e746372aede',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.208761] env[65337]: INFO networking_nsxv3.common.synchronization [None req-c3a8c69c-9170-4cb4-a6e9-9c35f03cfdb4 None None] Enqueued Resource ID: 70014564-8ec4-4889-80f5-4f430b35231a with Priority: HIGHEST for action port [ 587.209544] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70014564-8ec4-4889-80f5-4f430b35231a with Priority: HIGHEST for action port [ 587.209856] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-70014564-8ec4-4889-80f5-4f430b35231a taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.209974] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-70014564-8ec4-4889-80f5-4f430b35231a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.210137] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-70014564-8ec4-4889-80f5-4f430b35231a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.210330] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-70014564-8ec4-4889-80f5-4f430b35231a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.210388] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('70014564-8ec4-4889-80f5-4f430b35231a',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.222897] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.222897] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.222897] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.222897] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.222897] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.222897] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f1f34466-ff97-435d-a02c-66b2c3da216c already deleted. [ 587.222897] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f1f34466-ff97-435d-a02c-66b2c3da216c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.365197] env[65337]: INFO networking_nsxv3.common.synchronization [req-552634e6-3587-4d35-ae40-a08cb2f95e0a req-762a37fa-af73-49c7-b1a0-af14862781cb tempest-ImagesTestJSON-1531636912 tempest-ImagesTestJSON-1531636912-project-member] Enqueued Resource ID: 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 with Priority: HIGHEST for action security_group_members [ 587.365941] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 with Priority: HIGHEST for action security_group_members [ 587.366560] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.366691] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.366759] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.367223] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.367404] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.367513] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.367579] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.367738] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.367828] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.367919] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7db87dc2-69af-45f1-90c2-f8a4ec96c3b7',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.509786] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-114a6017-3f79-438c-9593-053232b9f176 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.509993] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-114a6017-3f79-438c-9593-053232b9f176" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.517577] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('114a6017-3f79-438c-9593-053232b9f176',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.521071] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e4d2e5ae-c18a-4e93-9716-0e746372aede with status ACTIVE [ 587.521295] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.522129] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.522243] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.522454] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.522541] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.522815] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.522918] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.522977] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.523274] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.523441] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.524170] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.524170] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.524170] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.524170] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.524170] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.524170] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e4d2e5ae-c18a-4e93-9716-0e746372aede is going to be updated. [ 587.547308] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.547450] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.547516] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.547719] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.547847] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.547988] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e4d2e5ae-c18a-4e93-9716-0e746372aede" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.611801] env[65337]: INFO networking_nsxv3.common.synchronization [None req-85d1b8c3-38c6-4f07-943c-ea26d77ff338 None None] Enqueued Resource ID: b0920578-7c0b-466e-8e19-76db5b2f073d with Priority: HIGHEST for action port [ 587.614469] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0920578-7c0b-466e-8e19-76db5b2f073d with Priority: HIGHEST for action port [ 587.615857] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-b0920578-7c0b-466e-8e19-76db5b2f073d taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.615857] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b0920578-7c0b-466e-8e19-76db5b2f073d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.615857] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b0920578-7c0b-466e-8e19-76db5b2f073d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.616136] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b0920578-7c0b-466e-8e19-76db5b2f073d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.616136] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b0920578-7c0b-466e-8e19-76db5b2f073d',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.713989] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 70014564-8ec4-4889-80f5-4f430b35231a [ 587.713989] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.713989] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.713989] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.713989] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.713989] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.713989] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:70014564-8ec4-4889-80f5-4f430b35231a already deleted. [ 587.713989] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-70014564-8ec4-4889-80f5-4f430b35231a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.848416] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock network-626 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.848558] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "network-626" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.848558] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "network-626" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.849356] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "network-626" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.849356] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.849356] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.849356] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.849624] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.849811] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.849903] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 587.850049] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 587.850429] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 587.850539] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 587.850648] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 587.850751] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 587.850877] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 587.871127] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 587.871217] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 587.871332] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 587.871510] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "network-626" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.871840] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock port-31f228c5-8663-4720-a95a-fb490c1e5c19 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.872025] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "port-31f228c5-8663-4720-a95a-fb490c1e5c19" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.872151] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "port-31f228c5-8663-4720-a95a-fb490c1e5c19" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.872507] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "port-31f228c5-8663-4720-a95a-fb490c1e5c19" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.872623] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('31f228c5-8663-4720-a95a-fb490c1e5c19',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.875517] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.875979] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.875979] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.876291] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.876291] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.876291] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.876428] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.876428] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.876611] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.876655] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.876760] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 already deleted. [ 587.876791] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.028201] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('114a6017-3f79-438c-9593-053232b9f176',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.116313] env[65337]: INFO networking_nsxv3.common.synchronization [None req-36b75480-9608-4098-bf89-c9799645ef64 tempest-VolumesAssistedSnapshotsTest-855556220 tempest-VolumesAssistedSnapshotsTest-855556220-project-member] Enqueued Resource ID: 1063e362-e6bc-4ee7-8518-83d8fe445cb4 with Priority: HIGHEST for action security_group_rules [ 588.117135] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1063e362-e6bc-4ee7-8518-83d8fe445cb4 with Priority: HIGHEST for action security_group_rules [ 588.117453] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1063e362-e6bc-4ee7-8518-83d8fe445cb4 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.117588] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1063e362-e6bc-4ee7-8518-83d8fe445cb4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.117684] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1063e362-e6bc-4ee7-8518-83d8fe445cb4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.117981] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1063e362-e6bc-4ee7-8518-83d8fe445cb4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.118202] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1063e362-e6bc-4ee7-8518-83d8fe445cb4',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.119025] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b0920578-7c0b-466e-8e19-76db5b2f073d [ 588.119912] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.119912] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.119912] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.119912] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.119912] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.119912] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b0920578-7c0b-466e-8e19-76db5b2f073d already deleted. [ 588.119912] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b0920578-7c0b-466e-8e19-76db5b2f073d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.378234] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.378759] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.378986] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.379292] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.379440] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.379593] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Segment Port 31f228c5-8663-4720-a95a-fb490c1e5c19 not found, creating... [ 588.379998] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.380613] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.380613] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.380613] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.380613] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.380950] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.380950] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.381052] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.381575] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.381575] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.381575] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Resource: SegmentPort with ID: 31f228c5-8663-4720-a95a-fb490c1e5c19 is going to be created. [ 588.403264] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.403509] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.403628] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.403877] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.404098] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.404306] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "port-31f228c5-8663-4720-a95a-fb490c1e5c19" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.417788] env[65337]: INFO networking_nsxv3.common.synchronization [None req-7be98d88-5d03-4589-8166-f624d5e82a3e tempest-VolumesAssistedSnapshotsTest-855556220 tempest-VolumesAssistedSnapshotsTest-855556220-project-member] Enqueued Resource ID: 1063e362-e6bc-4ee7-8518-83d8fe445cb4 with Priority: HIGHEST for action security_group_rules [ 588.418395] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1063e362-e6bc-4ee7-8518-83d8fe445cb4 with Priority: HIGHEST for action security_group_rules [ 588.418651] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1063e362-e6bc-4ee7-8518-83d8fe445cb4 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.418796] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1063e362-e6bc-4ee7-8518-83d8fe445cb4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.532847] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.532847] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.532847] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.532847] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.532847] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.532847] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 114a6017-3f79-438c-9593-053232b9f176 is going to be created. [ 588.665886] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.666140] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.666140] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.666378] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.666584] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.668991] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.669466] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.670176] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.670176] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.670176] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.670176] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1063e362-e6bc-4ee7-8518-83d8fe445cb4 already deleted. [ 588.670176] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1063e362-e6bc-4ee7-8518-83d8fe445cb4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.670700] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1063e362-e6bc-4ee7-8518-83d8fe445cb4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.670899] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1063e362-e6bc-4ee7-8518-83d8fe445cb4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.670991] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1063e362-e6bc-4ee7-8518-83d8fe445cb4',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.679632] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 114a6017-3f79-438c-9593-053232b9f176 in Status: UNINITIALIZED for 2s [ 589.083073] env[65337]: INFO networking_nsxv3.common.synchronization [req-552634e6-3587-4d35-ae40-a08cb2f95e0a req-12752130-2db3-4230-a823-8bb29eba6227 service nova] Enqueued Resource ID: 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 with Priority: HIGHEST for action security_group_rules [ 589.083073] env[65337]: INFO networking_nsxv3.common.synchronization [req-552634e6-3587-4d35-ae40-a08cb2f95e0a req-12752130-2db3-4230-a823-8bb29eba6227 service nova] Enqueued Resource ID: 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 with Priority: HIGHEST for action security_group_members [ 589.083426] env[65337]: INFO networking_nsxv3.common.synchronization [req-552634e6-3587-4d35-ae40-a08cb2f95e0a req-12752130-2db3-4230-a823-8bb29eba6227 service nova] Enqueued Resource ID: 31f228c5-8663-4720-a95a-fb490c1e5c19 with Priority: HIGHEST for action port [ 589.084030] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 with Priority: HIGHEST for action security_group_rules [ 589.084178] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 with Priority: HIGHEST for action security_group_members [ 589.084699] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31f228c5-8663-4720-a95a-fb490c1e5c19 with Priority: HIGHEST for action port [ 589.085106] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.085106] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.085186] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.085418] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.085501] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7db87dc2-69af-45f1-90c2-f8a4ec96c3b7',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.086363] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.086480] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.086552] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.086710] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.086901] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.086971] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.087021] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.087150] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.087235] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.087322] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7db87dc2-69af-45f1-90c2-f8a4ec96c3b7',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.092288] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-31f228c5-8663-4720-a95a-fb490c1e5c19 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.092288] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-31f228c5-8663-4720-a95a-fb490c1e5c19" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.092288] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-31f228c5-8663-4720-a95a-fb490c1e5c19" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.092288] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-31f228c5-8663-4720-a95a-fb490c1e5c19" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.092288] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('31f228c5-8663-4720-a95a-fb490c1e5c19',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.191838] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.191996] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.192058] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.192806] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.192806] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.192806] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1063e362-e6bc-4ee7-8518-83d8fe445cb4 already deleted. [ 589.192806] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1063e362-e6bc-4ee7-8518-83d8fe445cb4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.591456] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.591756] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.594843] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7db87dc2-69af-45f1-90c2-f8a4ec96c3b7',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.595465] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 31f228c5-8663-4720-a95a-fb490c1e5c19 with status ACTIVE [ 589.596348] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.596542] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.596627] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.597450] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.597450] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.597450] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.597450] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.597450] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.597450] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.597450] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.597777] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.597777] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.597777] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.597952] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.597997] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.603027] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 31f228c5-8663-4720-a95a-fb490c1e5c19 is going to be updated. [ 589.623063] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.623233] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.623294] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.623673] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.623740] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.623856] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-31f228c5-8663-4720-a95a-fb490c1e5c19" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.956351] env[65337]: INFO networking_nsxv3.common.synchronization [req-03ea3408-393d-42b4-b510-6c7d7c065a33 req-7bb1ebb6-acce-4b6d-a550-3eedb1fbb87f tempest-MigrationsAdminTest-367558634 tempest-MigrationsAdminTest-367558634-project-member] Enqueued Resource ID: d8e2d833-6da9-488a-a2b1-f410f4205706 with Priority: HIGHEST for action security_group_members [ 589.956450] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8e2d833-6da9-488a-a2b1-f410f4205706 with Priority: HIGHEST for action security_group_members [ 589.956747] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8e2d833-6da9-488a-a2b1-f410f4205706 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.956872] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8e2d833-6da9-488a-a2b1-f410f4205706" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.956936] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8e2d833-6da9-488a-a2b1-f410f4205706" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.957653] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8e2d833-6da9-488a-a2b1-f410f4205706" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.957653] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.957653] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.957653] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.957830] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.957911] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.957970] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d8e2d833-6da9-488a-a2b1-f410f4205706',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.104539] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7db87dc2-69af-45f1-90c2-f8a4ec96c3b7',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.381183] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock network-292 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.381417] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "network-292" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.381567] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "network-292" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.381882] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "network-292" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.382172] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.382325] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.382436] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.382646] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.382780] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.382991] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 590.383814] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 590.383948] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 590.384073] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 590.384191] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 590.384281] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 590.384421] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 590.404149] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 590.404483] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 590.404483] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 590.404640] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "network-292" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.404938] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock port-46a0a552-f935-4161-897e-162ad7caeef8 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.405103] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "port-46a0a552-f935-4161-897e-162ad7caeef8" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.405157] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "port-46a0a552-f935-4161-897e-162ad7caeef8" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.405575] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "port-46a0a552-f935-4161-897e-162ad7caeef8" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.405811] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('46a0a552-f935-4161-897e-162ad7caeef8',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.460275] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.460716] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.460801] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.461031] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.461128] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.461323] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.461427] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.461614] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.461677] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.461760] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.461804] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8e2d833-6da9-488a-a2b1-f410f4205706 already deleted. [ 590.461864] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8e2d833-6da9-488a-a2b1-f410f4205706" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.604550] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.605073] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.605073] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.605073] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.605426] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.605426] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 is going to be created. [ 590.633225] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.633537] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.633537] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.633773] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.634366] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.648703] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 in Status: UNINITIALIZED for 2s [ 590.675476] env[65337]: INFO networking_nsxv3.common.synchronization [None req-495d88f2-f34d-4163-9287-16a2b6568d12 tempest-ServersTestManualDisk-1284221232 tempest-ServersTestManualDisk-1284221232-project-member] Enqueued Resource ID: 4f8577ef-eb55-481e-9197-98761298b164 with Priority: HIGHEST for action security_group_rules [ 590.676113] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f8577ef-eb55-481e-9197-98761298b164 with Priority: HIGHEST for action security_group_rules [ 590.676500] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4f8577ef-eb55-481e-9197-98761298b164 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.676698] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4f8577ef-eb55-481e-9197-98761298b164" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.676799] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4f8577ef-eb55-481e-9197-98761298b164" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.677150] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4f8577ef-eb55-481e-9197-98761298b164" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.677926] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4f8577ef-eb55-481e-9197-98761298b164',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.690295] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 114a6017-3f79-438c-9593-053232b9f176 in Status: SUCCESS [ 590.691187] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-114a6017-3f79-438c-9593-053232b9f176" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.691951] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-114a6017-3f79-438c-9593-053232b9f176" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.692213] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-114a6017-3f79-438c-9593-053232b9f176" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.692989] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.692989] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.692989] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.692989] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.692989] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.692989] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-114a6017-3f79-438c-9593-053232b9f176" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.693743] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('114a6017-3f79-438c-9593-053232b9f176',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.868278] env[65337]: INFO networking_nsxv3.common.synchronization [None req-0ac289b9-a25a-4377-aac6-5c073559c1b7 None None] Enqueued Resource ID: 5d610b46-4aa5-436a-92ad-ad88ff3d260f with Priority: HIGHEST for action port [ 590.868278] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d610b46-4aa5-436a-92ad-ad88ff3d260f with Priority: HIGHEST for action port [ 590.868278] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-5d610b46-4aa5-436a-92ad-ad88ff3d260f taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.868278] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5d610b46-4aa5-436a-92ad-ad88ff3d260f" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.868278] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5d610b46-4aa5-436a-92ad-ad88ff3d260f" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.868278] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5d610b46-4aa5-436a-92ad-ad88ff3d260f" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.868278] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5d610b46-4aa5-436a-92ad-ad88ff3d260f',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.911809] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.911809] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.911809] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.912086] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.912308] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.912411] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Segment Port 46a0a552-f935-4161-897e-162ad7caeef8 not found, creating... [ 590.912707] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.913741] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.913741] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.913741] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.913741] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.913741] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.913959] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.913959] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.914097] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.914247] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.914369] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Resource: SegmentPort with ID: 46a0a552-f935-4161-897e-162ad7caeef8 is going to be created. [ 590.934952] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.935167] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.935284] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.935537] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.935915] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.936147] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "port-46a0a552-f935-4161-897e-162ad7caeef8" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.103495] env[65337]: INFO networking_nsxv3.common.synchronization [None req-386bed2b-097f-46a4-9f8f-76c9b8f5236b tempest-ServersTestManualDisk-1284221232 tempest-ServersTestManualDisk-1284221232-project-member] Enqueued Resource ID: 4f8577ef-eb55-481e-9197-98761298b164 with Priority: HIGHEST for action security_group_rules [ 591.104118] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f8577ef-eb55-481e-9197-98761298b164 with Priority: HIGHEST for action security_group_rules [ 591.104305] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4f8577ef-eb55-481e-9197-98761298b164 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.104414] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4f8577ef-eb55-481e-9197-98761298b164" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.200867] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-114a6017-3f79-438c-9593-053232b9f176 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.200867] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-114a6017-3f79-438c-9593-053232b9f176" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.200867] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-114a6017-3f79-438c-9593-053232b9f176" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.200867] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-114a6017-3f79-438c-9593-053232b9f176" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.200867] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.200867] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.200867] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.200867] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.200867] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.200867] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-114a6017-3f79-438c-9593-053232b9f176" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.200867] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-114a6017-3f79-438c-9593-053232b9f176 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.200867] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-114a6017-3f79-438c-9593-053232b9f176" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.200867] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-114a6017-3f79-438c-9593-053232b9f176" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.200867] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-114a6017-3f79-438c-9593-053232b9f176" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.200867] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.200867] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.201438] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.201438] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.201438] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.201438] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-114a6017-3f79-438c-9593-053232b9f176" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.201438] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('114a6017-3f79-438c-9593-053232b9f176',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.202519] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.202938] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.203333] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.203812] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.204248] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.204248] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4f8577ef-eb55-481e-9197-98761298b164 already deleted. [ 591.205134] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4f8577ef-eb55-481e-9197-98761298b164" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.205134] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4f8577ef-eb55-481e-9197-98761298b164" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.205134] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4f8577ef-eb55-481e-9197-98761298b164" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.205294] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4f8577ef-eb55-481e-9197-98761298b164',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.375240] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5d610b46-4aa5-436a-92ad-ad88ff3d260f [ 591.375508] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.375650] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.375777] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.376436] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.376436] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.376436] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5d610b46-4aa5-436a-92ad-ad88ff3d260f already deleted. [ 591.376436] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5d610b46-4aa5-436a-92ad-ad88ff3d260f" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.624757] env[65337]: INFO networking_nsxv3.common.synchronization [req-03ea3408-393d-42b4-b510-6c7d7c065a33 req-b082b21b-8bd4-4150-9d82-7c297a990319 service nova] Enqueued Resource ID: d8e2d833-6da9-488a-a2b1-f410f4205706 with Priority: HIGHEST for action security_group_rules [ 591.624757] env[65337]: INFO networking_nsxv3.common.synchronization [req-03ea3408-393d-42b4-b510-6c7d7c065a33 req-b082b21b-8bd4-4150-9d82-7c297a990319 service nova] Enqueued Resource ID: d8e2d833-6da9-488a-a2b1-f410f4205706 with Priority: HIGHEST for action security_group_members [ 591.625086] env[65337]: INFO networking_nsxv3.common.synchronization [req-03ea3408-393d-42b4-b510-6c7d7c065a33 req-b082b21b-8bd4-4150-9d82-7c297a990319 service nova] Enqueued Resource ID: 46a0a552-f935-4161-897e-162ad7caeef8 with Priority: HIGHEST for action port [ 591.625497] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8e2d833-6da9-488a-a2b1-f410f4205706 with Priority: HIGHEST for action security_group_rules [ 591.625497] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8e2d833-6da9-488a-a2b1-f410f4205706 with Priority: HIGHEST for action security_group_members [ 591.625633] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46a0a552-f935-4161-897e-162ad7caeef8 with Priority: HIGHEST for action port [ 591.626348] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d8e2d833-6da9-488a-a2b1-f410f4205706 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.626348] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d8e2d833-6da9-488a-a2b1-f410f4205706" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.626348] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d8e2d833-6da9-488a-a2b1-f410f4205706" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.626348] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d8e2d833-6da9-488a-a2b1-f410f4205706" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.626660] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d8e2d833-6da9-488a-a2b1-f410f4205706',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.627419] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8e2d833-6da9-488a-a2b1-f410f4205706 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.627672] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8e2d833-6da9-488a-a2b1-f410f4205706" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.627672] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8e2d833-6da9-488a-a2b1-f410f4205706" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.627811] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8e2d833-6da9-488a-a2b1-f410f4205706" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.628036] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.628088] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.628149] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.628281] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.628378] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.628478] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d8e2d833-6da9-488a-a2b1-f410f4205706',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.629233] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-46a0a552-f935-4161-897e-162ad7caeef8 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.629368] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-46a0a552-f935-4161-897e-162ad7caeef8" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.629439] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-46a0a552-f935-4161-897e-162ad7caeef8" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.629575] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-46a0a552-f935-4161-897e-162ad7caeef8" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.629648] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('46a0a552-f935-4161-897e-162ad7caeef8',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.707932] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 114a6017-3f79-438c-9593-053232b9f176: rpc.has_security_group_logging(os_id): False [ 591.730299] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.730481] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.730522] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.730745] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.730839] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.731074] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.731163] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.731215] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.731362] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.731440] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.731623] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.731711] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.731770] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.731904] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.731976] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.732162] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.732255] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.732310] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.732446] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.732542] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.732611] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 114a6017-3f79-438c-9593-053232b9f176 is going to be created. [ 591.735141] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.735255] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.735361] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.735479] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.735561] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.735647] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4f8577ef-eb55-481e-9197-98761298b164 already deleted. [ 591.735756] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4f8577ef-eb55-481e-9197-98761298b164" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.802496] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.802670] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.802754] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.802948] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.803145] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.816633] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 114a6017-3f79-438c-9593-053232b9f176 in Status: IN_PROGRESS for 2s [ 592.132707] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d8e2d833-6da9-488a-a2b1-f410f4205706',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.133120] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8e2d833-6da9-488a-a2b1-f410f4205706 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.134694] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8e2d833-6da9-488a-a2b1-f410f4205706" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.134694] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 46a0a552-f935-4161-897e-162ad7caeef8 with status ACTIVE [ 592.134694] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.134694] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.134694] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.135891] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.135891] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.136228] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.138690] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.138690] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.138690] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.138690] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.138690] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.138690] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.138690] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.138690] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.138690] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.138690] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 46a0a552-f935-4161-897e-162ad7caeef8 is going to be updated. [ 592.163623] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.163623] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.163623] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.163623] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.163623] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.163623] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-46a0a552-f935-4161-897e-162ad7caeef8" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.641140] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d8e2d833-6da9-488a-a2b1-f410f4205706',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.659539] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 in Status: SUCCESS [ 592.659835] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.660181] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.660398] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.660653] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.660795] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.660976] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.661025] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.661153] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.661206] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.661432] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7db87dc2-69af-45f1-90c2-f8a4ec96c3b7',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.946453] env[65337]: INFO networking_nsxv3.common.synchronization [req-f1184a76-e87b-431b-9f09-350c9ec73e28 req-b95f1c5a-b0af-4218-aed8-f1a98a3a42f3 tempest-DeleteServersAdminTestJSON-1195367916 tempest-DeleteServersAdminTestJSON-1195367916-project-member] Enqueued Resource ID: a4c4fbaa-f4c9-4326-babb-bda6619acdf6 with Priority: HIGHEST for action security_group_members [ 592.946979] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4c4fbaa-f4c9-4326-babb-bda6619acdf6 with Priority: HIGHEST for action security_group_members [ 592.947373] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4c4fbaa-f4c9-4326-babb-bda6619acdf6 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.947542] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4c4fbaa-f4c9-4326-babb-bda6619acdf6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.947542] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4c4fbaa-f4c9-4326-babb-bda6619acdf6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.947750] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4c4fbaa-f4c9-4326-babb-bda6619acdf6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.947907] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.948046] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.948329] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.948522] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.948622] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.948787] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a4c4fbaa-f4c9-4326-babb-bda6619acdf6',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.143796] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.144070] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.144203] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.144646] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.144821] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.144965] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8e2d833-6da9-488a-a2b1-f410f4205706 is going to be created. [ 593.167110] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.167110] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.167110] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.167110] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.167110] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.167539] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.167754] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.168693] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.168939] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.169189] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.169470] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.170204] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.170379] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.170638] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.171246] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.172985] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.173111] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.173330] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.173505] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.173642] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.173783] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7db87dc2-69af-45f1-90c2-f8a4ec96c3b7',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.177271] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.177486] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.177603] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.177824] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.178040] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.189833] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8e2d833-6da9-488a-a2b1-f410f4205706 in Status: UNINITIALIZED for 2s [ 593.451792] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.452069] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.452181] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.452503] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.452678] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.453024] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.453177] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.453272] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.453563] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.453726] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.453877] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4c4fbaa-f4c9-4326-babb-bda6619acdf6 already deleted. [ 593.454528] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4c4fbaa-f4c9-4326-babb-bda6619acdf6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.680887] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7: rpc.has_security_group_logging(os_id): False [ 593.705795] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.705795] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.705795] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.705795] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.705795] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.705795] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.705795] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.705795] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.705795] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.705795] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.705795] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.705795] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.705795] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.705795] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.705795] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.706891] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.706891] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.706891] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.706891] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.707116] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.707202] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 is going to be created. [ 593.768206] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.768424] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.769053] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.769053] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.769295] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.783085] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 in Status: IN_PROGRESS for 2s [ 593.830540] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 114a6017-3f79-438c-9593-053232b9f176 in Status: SUCCESS [ 593.830957] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-114a6017-3f79-438c-9593-053232b9f176" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.918820] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock network-292 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.919962] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "network-292" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.919962] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "network-292" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.919962] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "network-292" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.919962] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.919962] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.920393] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.920600] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.920770] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.921018] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 593.921198] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 593.921638] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 593.921638] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 593.921638] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 593.921790] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 593.921790] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 593.943772] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 593.943936] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 593.945395] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 593.945395] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "network-292" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.945395] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock port-70503ea0-b5a1-466d-9941-6358d57147cf taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.945395] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "port-70503ea0-b5a1-466d-9941-6358d57147cf" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.945395] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "port-70503ea0-b5a1-466d-9941-6358d57147cf" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.945395] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "port-70503ea0-b5a1-466d-9941-6358d57147cf" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.945782] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('70503ea0-b5a1-466d-9941-6358d57147cf',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.127848] env[65337]: INFO networking_nsxv3.common.synchronization [None req-bb8b0738-49f0-4e96-994d-b7e8aaba82c5 None None] Enqueued Resource ID: ff727975-6bb7-4107-9fb0-01bfd3c536ab with Priority: HIGHEST for action port [ 594.127848] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff727975-6bb7-4107-9fb0-01bfd3c536ab with Priority: HIGHEST for action port [ 594.127848] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-ff727975-6bb7-4107-9fb0-01bfd3c536ab taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.127848] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ff727975-6bb7-4107-9fb0-01bfd3c536ab" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.127848] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ff727975-6bb7-4107-9fb0-01bfd3c536ab" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.131463] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ff727975-6bb7-4107-9fb0-01bfd3c536ab" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.131463] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ff727975-6bb7-4107-9fb0-01bfd3c536ab',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.168272] env[65337]: INFO networking_nsxv3.common.synchronization [None req-d4a6ca1a-1b19-4002-b9ce-3eaa32b13bad None None] Enqueued Resource ID: fcd8b890-d48c-4811-b2a1-965d6d28fc79 with Priority: HIGHEST for action port [ 594.168585] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fcd8b890-d48c-4811-b2a1-965d6d28fc79 with Priority: HIGHEST for action port [ 594.168912] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-fcd8b890-d48c-4811-b2a1-965d6d28fc79 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.169078] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fcd8b890-d48c-4811-b2a1-965d6d28fc79" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.169150] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fcd8b890-d48c-4811-b2a1-965d6d28fc79" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.169506] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fcd8b890-d48c-4811-b2a1-965d6d28fc79" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.169551] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fcd8b890-d48c-4811-b2a1-965d6d28fc79',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.448790] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.449101] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.449290] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.449636] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.449842] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.450130] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Segment Port 70503ea0-b5a1-466d-9941-6358d57147cf not found, creating... [ 594.450409] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.451194] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.451194] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.451194] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.451194] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.451446] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.451897] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.451897] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.451995] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.452138] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.452288] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Resource: SegmentPort with ID: 70503ea0-b5a1-466d-9941-6358d57147cf is going to be created. [ 594.476262] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.476446] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.476592] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.476922] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.477195] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.477407] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "port-70503ea0-b5a1-466d-9941-6358d57147cf" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.632394] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ff727975-6bb7-4107-9fb0-01bfd3c536ab [ 594.632394] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.632394] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.632394] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.632394] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.632394] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.632394] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ff727975-6bb7-4107-9fb0-01bfd3c536ab already deleted. [ 594.632394] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ff727975-6bb7-4107-9fb0-01bfd3c536ab" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.672775] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fcd8b890-d48c-4811-b2a1-965d6d28fc79 [ 594.673760] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.673760] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.673956] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.674118] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.674234] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.674345] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fcd8b890-d48c-4811-b2a1-965d6d28fc79 already deleted. [ 594.674462] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fcd8b890-d48c-4811-b2a1-965d6d28fc79" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.205751] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8e2d833-6da9-488a-a2b1-f410f4205706 in Status: SUCCESS [ 595.206094] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8e2d833-6da9-488a-a2b1-f410f4205706" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.206094] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8e2d833-6da9-488a-a2b1-f410f4205706" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.206315] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8e2d833-6da9-488a-a2b1-f410f4205706" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.206596] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.206723] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.206723] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.206851] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.206946] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.207051] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8e2d833-6da9-488a-a2b1-f410f4205706" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.207156] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d8e2d833-6da9-488a-a2b1-f410f4205706',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.312016] env[65337]: INFO networking_nsxv3.common.synchronization [req-f1184a76-e87b-431b-9f09-350c9ec73e28 req-ddcb81a6-b1df-4297-ba36-7364d3bef007 service nova] Enqueued Resource ID: a4c4fbaa-f4c9-4326-babb-bda6619acdf6 with Priority: HIGHEST for action security_group_rules [ 595.312250] env[65337]: INFO networking_nsxv3.common.synchronization [req-f1184a76-e87b-431b-9f09-350c9ec73e28 req-ddcb81a6-b1df-4297-ba36-7364d3bef007 service nova] Enqueued Resource ID: a4c4fbaa-f4c9-4326-babb-bda6619acdf6 with Priority: HIGHEST for action security_group_members [ 595.312314] env[65337]: INFO networking_nsxv3.common.synchronization [req-f1184a76-e87b-431b-9f09-350c9ec73e28 req-ddcb81a6-b1df-4297-ba36-7364d3bef007 service nova] Enqueued Resource ID: 70503ea0-b5a1-466d-9941-6358d57147cf with Priority: HIGHEST for action port [ 595.312838] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4c4fbaa-f4c9-4326-babb-bda6619acdf6 with Priority: HIGHEST for action security_group_rules [ 595.312997] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4c4fbaa-f4c9-4326-babb-bda6619acdf6 with Priority: HIGHEST for action security_group_members [ 595.313697] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70503ea0-b5a1-466d-9941-6358d57147cf with Priority: HIGHEST for action port [ 595.313697] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a4c4fbaa-f4c9-4326-babb-bda6619acdf6 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.314092] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a4c4fbaa-f4c9-4326-babb-bda6619acdf6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.314092] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a4c4fbaa-f4c9-4326-babb-bda6619acdf6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.314202] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a4c4fbaa-f4c9-4326-babb-bda6619acdf6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.314202] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a4c4fbaa-f4c9-4326-babb-bda6619acdf6',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.315990] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4c4fbaa-f4c9-4326-babb-bda6619acdf6 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.315990] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4c4fbaa-f4c9-4326-babb-bda6619acdf6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.315990] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4c4fbaa-f4c9-4326-babb-bda6619acdf6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.315990] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4c4fbaa-f4c9-4326-babb-bda6619acdf6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.315990] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.315990] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.316314] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.316314] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.316314] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.316420] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a4c4fbaa-f4c9-4326-babb-bda6619acdf6',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.318183] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-70503ea0-b5a1-466d-9941-6358d57147cf taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.318183] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-70503ea0-b5a1-466d-9941-6358d57147cf" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.318183] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-70503ea0-b5a1-466d-9941-6358d57147cf" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.319219] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-70503ea0-b5a1-466d-9941-6358d57147cf" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.319219] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('70503ea0-b5a1-466d-9941-6358d57147cf',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.710713] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8e2d833-6da9-488a-a2b1-f410f4205706 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.710898] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8e2d833-6da9-488a-a2b1-f410f4205706" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.710898] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8e2d833-6da9-488a-a2b1-f410f4205706" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.711157] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8e2d833-6da9-488a-a2b1-f410f4205706" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.711336] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.711433] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.711562] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.711658] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.711749] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.711828] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8e2d833-6da9-488a-a2b1-f410f4205706" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.711973] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8e2d833-6da9-488a-a2b1-f410f4205706 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.712078] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8e2d833-6da9-488a-a2b1-f410f4205706" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.712134] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8e2d833-6da9-488a-a2b1-f410f4205706" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.712298] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8e2d833-6da9-488a-a2b1-f410f4205706" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.712484] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.712589] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.712811] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.712811] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.712903] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.712903] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8e2d833-6da9-488a-a2b1-f410f4205706" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.712992] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d8e2d833-6da9-488a-a2b1-f410f4205706',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.796936] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 in Status: SUCCESS [ 595.797183] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.821697] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a4c4fbaa-f4c9-4326-babb-bda6619acdf6',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.822780] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4c4fbaa-f4c9-4326-babb-bda6619acdf6 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.822889] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4c4fbaa-f4c9-4326-babb-bda6619acdf6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.823100] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 70503ea0-b5a1-466d-9941-6358d57147cf with status ACTIVE [ 595.823266] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.823378] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.823501] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.823712] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.823802] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.823968] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.824072] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.824128] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.824276] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.824351] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.824557] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.824649] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.824708] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.824842] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.824914] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.824997] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 70503ea0-b5a1-466d-9941-6358d57147cf is going to be updated. [ 595.850131] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.850287] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.850287] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.850530] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.850621] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.850774] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-70503ea0-b5a1-466d-9941-6358d57147cf" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.120482] env[65337]: INFO networking_nsxv3.common.synchronization [None req-3e7f3285-cee9-4015-9d89-51cf350e9c2e None None] Enqueued Resource ID: 8f121bed-7a72-41a4-baf2-33cc8ab557b9 with Priority: HIGHEST for action port [ 596.121729] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f121bed-7a72-41a4-baf2-33cc8ab557b9 with Priority: HIGHEST for action port [ 596.121729] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-8f121bed-7a72-41a4-baf2-33cc8ab557b9 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.121911] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8f121bed-7a72-41a4-baf2-33cc8ab557b9" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.121911] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8f121bed-7a72-41a4-baf2-33cc8ab557b9" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.122132] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8f121bed-7a72-41a4-baf2-33cc8ab557b9" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.123114] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8f121bed-7a72-41a4-baf2-33cc8ab557b9',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.215156] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d8e2d833-6da9-488a-a2b1-f410f4205706: rpc.has_security_group_logging(os_id): False [ 596.235685] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.235685] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.235685] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.236152] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.236379] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.236703] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.237024] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.238017] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.238017] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.238017] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.238017] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.238017] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.238017] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.238017] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.238869] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.239336] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.239670] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.240043] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.241278] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.241278] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.241278] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d8e2d833-6da9-488a-a2b1-f410f4205706 is going to be created. [ 596.304429] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.304429] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.304429] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.304429] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.304429] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.316917] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d8e2d833-6da9-488a-a2b1-f410f4205706 in Status: IN_PROGRESS for 2s [ 596.333832] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a4c4fbaa-f4c9-4326-babb-bda6619acdf6',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.624775] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8f121bed-7a72-41a4-baf2-33cc8ab557b9 [ 596.625749] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.626129] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.626397] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.626750] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.626973] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.627212] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8f121bed-7a72-41a4-baf2-33cc8ab557b9 already deleted. [ 596.627649] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8f121bed-7a72-41a4-baf2-33cc8ab557b9" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.671448] env[65337]: INFO networking_nsxv3.common.synchronization [None req-979aaf45-62ce-498f-91a0-6dedd90614eb None None] Enqueued Resource ID: fe630545-d9ef-44ea-913b-2d951d6d305a with Priority: HIGHEST for action port [ 596.671448] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe630545-d9ef-44ea-913b-2d951d6d305a with Priority: HIGHEST for action port [ 596.671448] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-fe630545-d9ef-44ea-913b-2d951d6d305a taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.671448] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fe630545-d9ef-44ea-913b-2d951d6d305a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.671448] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fe630545-d9ef-44ea-913b-2d951d6d305a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.671448] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fe630545-d9ef-44ea-913b-2d951d6d305a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.671448] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe630545-d9ef-44ea-913b-2d951d6d305a',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.836215] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.836215] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.836215] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.836472] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.836671] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.836671] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4c4fbaa-f4c9-4326-babb-bda6619acdf6 is going to be created. [ 596.863253] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.869254] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.869254] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.869254] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.869254] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.883784] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4c4fbaa-f4c9-4326-babb-bda6619acdf6 in Status: UNINITIALIZED for 2s [ 597.174562] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fe630545-d9ef-44ea-913b-2d951d6d305a [ 597.174834] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.174971] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.175054] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.175297] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.175480] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.175480] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fe630545-d9ef-44ea-913b-2d951d6d305a already deleted. [ 597.175591] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fe630545-d9ef-44ea-913b-2d951d6d305a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.873325] env[65337]: INFO networking_nsxv3.common.synchronization [None req-b3aaa47b-8222-4a04-8a95-4536e24d7489 None None] Enqueued Resource ID: ef989331-eb53-4149-819f-0ecabc52e56f with Priority: HIGHEST for action port [ 597.874375] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef989331-eb53-4149-819f-0ecabc52e56f with Priority: HIGHEST for action port [ 597.875790] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-ef989331-eb53-4149-819f-0ecabc52e56f taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.875790] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ef989331-eb53-4149-819f-0ecabc52e56f" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.875790] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ef989331-eb53-4149-819f-0ecabc52e56f" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.875790] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ef989331-eb53-4149-819f-0ecabc52e56f" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.875790] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ef989331-eb53-4149-819f-0ecabc52e56f',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.331856] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d8e2d833-6da9-488a-a2b1-f410f4205706 in Status: SUCCESS [ 598.332067] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d8e2d833-6da9-488a-a2b1-f410f4205706" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.377579] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ef989331-eb53-4149-819f-0ecabc52e56f [ 598.378240] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.378240] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.378240] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.378240] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.378441] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.378441] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ef989331-eb53-4149-819f-0ecabc52e56f already deleted. [ 598.378509] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ef989331-eb53-4149-819f-0ecabc52e56f" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.778602] env[65337]: INFO networking_nsxv3.common.synchronization [None req-70bf41fe-0069-45c7-bb4f-b6be9cfe4c4a tempest-ServerActionsTestOtherB-648353996 tempest-ServerActionsTestOtherB-648353996-project-member] Enqueued Resource ID: d4ff60fe-3407-42aa-b33c-6254779ad495 with Priority: HIGHEST for action security_group_rules [ 598.779442] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4ff60fe-3407-42aa-b33c-6254779ad495 with Priority: HIGHEST for action security_group_rules [ 598.779442] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d4ff60fe-3407-42aa-b33c-6254779ad495 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.779687] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d4ff60fe-3407-42aa-b33c-6254779ad495" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.779750] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d4ff60fe-3407-42aa-b33c-6254779ad495" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.780059] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d4ff60fe-3407-42aa-b33c-6254779ad495" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.780192] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d4ff60fe-3407-42aa-b33c-6254779ad495',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.896401] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4c4fbaa-f4c9-4326-babb-bda6619acdf6 in Status: SUCCESS [ 598.897140] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4c4fbaa-f4c9-4326-babb-bda6619acdf6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.897140] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4c4fbaa-f4c9-4326-babb-bda6619acdf6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.897140] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4c4fbaa-f4c9-4326-babb-bda6619acdf6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.897305] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.897373] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.897373] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.897829] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.897829] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.897829] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4c4fbaa-f4c9-4326-babb-bda6619acdf6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.897829] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a4c4fbaa-f4c9-4326-babb-bda6619acdf6',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.944201] env[65337]: INFO networking_nsxv3.common.synchronization [None req-3f3e4230-160d-4579-8193-f4fe6f5f1e68 tempest-ServerActionsTestOtherB-648353996 tempest-ServerActionsTestOtherB-648353996-project-member] Enqueued Resource ID: d4ff60fe-3407-42aa-b33c-6254779ad495 with Priority: HIGHEST for action security_group_rules [ 598.944764] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4ff60fe-3407-42aa-b33c-6254779ad495 with Priority: HIGHEST for action security_group_rules [ 598.945091] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d4ff60fe-3407-42aa-b33c-6254779ad495 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.945211] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d4ff60fe-3407-42aa-b33c-6254779ad495" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.307122] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.311032] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.311032] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.311032] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.311032] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.311032] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d4ff60fe-3407-42aa-b33c-6254779ad495 already deleted. [ 599.311032] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d4ff60fe-3407-42aa-b33c-6254779ad495" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.311032] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d4ff60fe-3407-42aa-b33c-6254779ad495" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.311032] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d4ff60fe-3407-42aa-b33c-6254779ad495" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.311032] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d4ff60fe-3407-42aa-b33c-6254779ad495',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.400617] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4c4fbaa-f4c9-4326-babb-bda6619acdf6 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.400861] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4c4fbaa-f4c9-4326-babb-bda6619acdf6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.400958] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4c4fbaa-f4c9-4326-babb-bda6619acdf6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.401319] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4c4fbaa-f4c9-4326-babb-bda6619acdf6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.401514] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.401622] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.401675] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.401841] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.401932] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.402117] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4c4fbaa-f4c9-4326-babb-bda6619acdf6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.402290] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4c4fbaa-f4c9-4326-babb-bda6619acdf6 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.402388] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4c4fbaa-f4c9-4326-babb-bda6619acdf6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.402449] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4c4fbaa-f4c9-4326-babb-bda6619acdf6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.402743] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4c4fbaa-f4c9-4326-babb-bda6619acdf6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.402926] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.403285] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.403285] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.403285] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.403513] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.403513] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4c4fbaa-f4c9-4326-babb-bda6619acdf6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.403750] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a4c4fbaa-f4c9-4326-babb-bda6619acdf6',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.689559] env[65337]: INFO networking_nsxv3.common.synchronization [None req-ce93f3a4-6099-4939-b5c1-a8cf67704f1a tempest-AttachInterfacesUnderV243Test-1010804015 tempest-AttachInterfacesUnderV243Test-1010804015-project-member] Enqueued Resource ID: 5afc8a2a-3bb1-4c3e-a10b-0941514929b4 with Priority: HIGHEST for action security_group_rules [ 599.690144] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5afc8a2a-3bb1-4c3e-a10b-0941514929b4 with Priority: HIGHEST for action security_group_rules [ 599.690577] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5afc8a2a-3bb1-4c3e-a10b-0941514929b4 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.690718] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5afc8a2a-3bb1-4c3e-a10b-0941514929b4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.690718] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5afc8a2a-3bb1-4c3e-a10b-0941514929b4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.691833] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5afc8a2a-3bb1-4c3e-a10b-0941514929b4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.691833] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5afc8a2a-3bb1-4c3e-a10b-0941514929b4',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.835159] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.835159] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.835159] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.835159] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.835159] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.835159] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d4ff60fe-3407-42aa-b33c-6254779ad495 already deleted. [ 599.835159] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d4ff60fe-3407-42aa-b33c-6254779ad495" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.907582] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a4c4fbaa-f4c9-4326-babb-bda6619acdf6: rpc.has_security_group_logging(os_id): False [ 599.927501] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.927501] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.927501] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.927686] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.927717] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.927946] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.928031] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.928075] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.928230] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.928307] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.928532] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.928598] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.928632] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.928920] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.928920] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.929111] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.929209] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.929270] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.929456] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.929503] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.929566] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a4c4fbaa-f4c9-4326-babb-bda6619acdf6 is going to be created. [ 599.992032] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.992235] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.992299] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.992510] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.992694] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.007175] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a4c4fbaa-f4c9-4326-babb-bda6619acdf6 in Status: IN_PROGRESS for 2s [ 600.216356] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.216568] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.216639] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.216796] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.216882] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.216979] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5afc8a2a-3bb1-4c3e-a10b-0941514929b4 already deleted. [ 600.217100] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5afc8a2a-3bb1-4c3e-a10b-0941514929b4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.355385] env[65337]: INFO networking_nsxv3.common.synchronization [None req-e09da2da-3881-4fd2-81bb-ee0481b25f98 tempest-AttachInterfacesUnderV243Test-1010804015 tempest-AttachInterfacesUnderV243Test-1010804015-project-member] Enqueued Resource ID: 5afc8a2a-3bb1-4c3e-a10b-0941514929b4 with Priority: HIGHEST for action security_group_rules [ 600.356168] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5afc8a2a-3bb1-4c3e-a10b-0941514929b4 with Priority: HIGHEST for action security_group_rules [ 600.356740] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5afc8a2a-3bb1-4c3e-a10b-0941514929b4 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.356740] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5afc8a2a-3bb1-4c3e-a10b-0941514929b4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.356740] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5afc8a2a-3bb1-4c3e-a10b-0941514929b4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.357199] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5afc8a2a-3bb1-4c3e-a10b-0941514929b4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.357199] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5afc8a2a-3bb1-4c3e-a10b-0941514929b4',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.488282] env[65337]: INFO networking_nsxv3.common.synchronization [None req-8985c193-8054-43e2-bbc6-38401fa7ad0e None None] Enqueued Resource ID: 1e2fedc0-9d64-4c68-9652-bc9f6918e8d5 with Priority: HIGHEST for action port [ 600.490185] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e2fedc0-9d64-4c68-9652-bc9f6918e8d5 with Priority: HIGHEST for action port [ 600.490737] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-1e2fedc0-9d64-4c68-9652-bc9f6918e8d5 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.491035] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1e2fedc0-9d64-4c68-9652-bc9f6918e8d5" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.491135] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1e2fedc0-9d64-4c68-9652-bc9f6918e8d5" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.491620] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1e2fedc0-9d64-4c68-9652-bc9f6918e8d5" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.491742] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1e2fedc0-9d64-4c68-9652-bc9f6918e8d5',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.876953] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.877133] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.877133] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.877562] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.877562] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.877687] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5afc8a2a-3bb1-4c3e-a10b-0941514929b4 already deleted. [ 600.877687] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5afc8a2a-3bb1-4c3e-a10b-0941514929b4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.993887] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1e2fedc0-9d64-4c68-9652-bc9f6918e8d5 [ 600.994398] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.994398] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.994398] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.994639] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.994767] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.994882] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1e2fedc0-9d64-4c68-9652-bc9f6918e8d5 already deleted. [ 600.994969] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1e2fedc0-9d64-4c68-9652-bc9f6918e8d5" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.010388] env[65337]: INFO networking_nsxv3.common.synchronization [req-877234c7-ed6c-4c5c-8db1-7a8ab504aa54 req-8215a991-658b-43f0-9939-ba0d8b019440 tempest-VolumesAssistedSnapshotsTest-855556220 tempest-VolumesAssistedSnapshotsTest-855556220-project-member] Enqueued Resource ID: 1063e362-e6bc-4ee7-8518-83d8fe445cb4 with Priority: HIGHEST for action security_group_members [ 602.011054] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1063e362-e6bc-4ee7-8518-83d8fe445cb4 with Priority: HIGHEST for action security_group_members [ 602.012217] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-1063e362-e6bc-4ee7-8518-83d8fe445cb4 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.012357] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1063e362-e6bc-4ee7-8518-83d8fe445cb4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.012427] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1063e362-e6bc-4ee7-8518-83d8fe445cb4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.012687] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1063e362-e6bc-4ee7-8518-83d8fe445cb4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.013247] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.013375] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.013505] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.013685] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.013776] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.013872] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1063e362-e6bc-4ee7-8518-83d8fe445cb4',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.022615] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a4c4fbaa-f4c9-4326-babb-bda6619acdf6 in Status: SUCCESS [ 602.022615] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a4c4fbaa-f4c9-4326-babb-bda6619acdf6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.350013] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock network-372 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.350136] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "network-372" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.350175] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "network-372" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.350515] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "network-372" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.350769] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.350934] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.351181] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.351921] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.351921] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.351921] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 602.351921] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 602.352117] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 602.352117] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 602.352199] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 602.352495] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 602.352495] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 602.373346] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 602.373346] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 602.373555] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 602.373760] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "network-372" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.374127] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock port-12daac3a-ab7b-4130-807d-c8a9714dff8e taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.374346] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "port-12daac3a-ab7b-4130-807d-c8a9714dff8e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.374454] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "port-12daac3a-ab7b-4130-807d-c8a9714dff8e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.374733] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "port-12daac3a-ab7b-4130-807d-c8a9714dff8e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.374868] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('12daac3a-ab7b-4130-807d-c8a9714dff8e',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.516848] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.517024] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.517100] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.517347] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.517444] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.517652] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.517750] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.517809] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.517967] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.518042] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.518124] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1063e362-e6bc-4ee7-8518-83d8fe445cb4 already deleted. [ 602.518199] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1063e362-e6bc-4ee7-8518-83d8fe445cb4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.882137] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.882137] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.882137] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.882137] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.882137] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.882137] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Segment Port 12daac3a-ab7b-4130-807d-c8a9714dff8e not found, creating... [ 602.882137] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.882137] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.882137] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.882137] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.882137] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.882572] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.882572] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.882572] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.882572] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.882860] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.883119] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Resource: SegmentPort with ID: 12daac3a-ab7b-4130-807d-c8a9714dff8e is going to be created. [ 602.910300] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.910300] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.910300] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.910300] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.910300] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.910300] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "port-12daac3a-ab7b-4130-807d-c8a9714dff8e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.731036] env[65337]: INFO networking_nsxv3.common.synchronization [req-877234c7-ed6c-4c5c-8db1-7a8ab504aa54 req-9a46907e-3662-44a6-96ee-48e7c68b16fa service nova] Enqueued Resource ID: 1063e362-e6bc-4ee7-8518-83d8fe445cb4 with Priority: HIGHEST for action security_group_rules [ 603.731036] env[65337]: INFO networking_nsxv3.common.synchronization [req-877234c7-ed6c-4c5c-8db1-7a8ab504aa54 req-9a46907e-3662-44a6-96ee-48e7c68b16fa service nova] Enqueued Resource ID: 1063e362-e6bc-4ee7-8518-83d8fe445cb4 with Priority: HIGHEST for action security_group_members [ 603.731036] env[65337]: INFO networking_nsxv3.common.synchronization [req-877234c7-ed6c-4c5c-8db1-7a8ab504aa54 req-9a46907e-3662-44a6-96ee-48e7c68b16fa service nova] Enqueued Resource ID: 12daac3a-ab7b-4130-807d-c8a9714dff8e with Priority: HIGHEST for action port [ 603.731036] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1063e362-e6bc-4ee7-8518-83d8fe445cb4 with Priority: HIGHEST for action security_group_rules [ 603.731036] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1063e362-e6bc-4ee7-8518-83d8fe445cb4 with Priority: HIGHEST for action security_group_members [ 603.731494] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12daac3a-ab7b-4130-807d-c8a9714dff8e with Priority: HIGHEST for action port [ 603.731695] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1063e362-e6bc-4ee7-8518-83d8fe445cb4 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.731817] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1063e362-e6bc-4ee7-8518-83d8fe445cb4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.731880] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1063e362-e6bc-4ee7-8518-83d8fe445cb4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.732084] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1063e362-e6bc-4ee7-8518-83d8fe445cb4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.732183] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1063e362-e6bc-4ee7-8518-83d8fe445cb4',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.733072] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-1063e362-e6bc-4ee7-8518-83d8fe445cb4 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.733182] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1063e362-e6bc-4ee7-8518-83d8fe445cb4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.733246] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1063e362-e6bc-4ee7-8518-83d8fe445cb4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.733450] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1063e362-e6bc-4ee7-8518-83d8fe445cb4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.733626] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.733726] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.733788] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.734666] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.734666] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.734666] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1063e362-e6bc-4ee7-8518-83d8fe445cb4',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.734874] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-12daac3a-ab7b-4130-807d-c8a9714dff8e taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.734976] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-12daac3a-ab7b-4130-807d-c8a9714dff8e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.735052] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-12daac3a-ab7b-4130-807d-c8a9714dff8e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.735201] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-12daac3a-ab7b-4130-807d-c8a9714dff8e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.735307] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('12daac3a-ab7b-4130-807d-c8a9714dff8e',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.239549] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-1063e362-e6bc-4ee7-8518-83d8fe445cb4 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.239757] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1063e362-e6bc-4ee7-8518-83d8fe445cb4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.239842] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1063e362-e6bc-4ee7-8518-83d8fe445cb4',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.241041] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 12daac3a-ab7b-4130-807d-c8a9714dff8e with status ACTIVE [ 604.241199] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.241199] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.241343] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.241509] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.241585] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.241767] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.241861] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.241915] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.242243] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.242243] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.244758] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.244933] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.245017] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.245260] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.245335] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.245434] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 12daac3a-ab7b-4130-807d-c8a9714dff8e is going to be updated. [ 604.271827] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.271827] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.271827] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.272256] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.272648] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.273338] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-12daac3a-ab7b-4130-807d-c8a9714dff8e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.567135] env[65337]: INFO networking_nsxv3.common.synchronization [req-961b388d-837a-4279-a220-6cab99802a66 req-1e905a41-e750-4af2-9896-5b369577a812 tempest-ServersTestManualDisk-1284221232 tempest-ServersTestManualDisk-1284221232-project-member] Enqueued Resource ID: 4f8577ef-eb55-481e-9197-98761298b164 with Priority: HIGHEST for action security_group_members [ 604.567900] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f8577ef-eb55-481e-9197-98761298b164 with Priority: HIGHEST for action security_group_members [ 604.568340] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f8577ef-eb55-481e-9197-98761298b164 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.568469] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f8577ef-eb55-481e-9197-98761298b164" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.568537] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f8577ef-eb55-481e-9197-98761298b164" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.569094] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f8577ef-eb55-481e-9197-98761298b164" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.569094] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.569094] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.569749] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.569749] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.569749] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.569749] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4f8577ef-eb55-481e-9197-98761298b164',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.748784] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1063e362-e6bc-4ee7-8518-83d8fe445cb4',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.074097] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.074097] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.074097] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.074097] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.074097] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.074097] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.074097] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.074097] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.074097] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.074097] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.074097] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f8577ef-eb55-481e-9197-98761298b164 already deleted. [ 605.074097] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f8577ef-eb55-481e-9197-98761298b164" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.256233] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.256233] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.256233] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.256233] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.256233] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.256233] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1063e362-e6bc-4ee7-8518-83d8fe445cb4 is going to be created. [ 605.284024] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.284024] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.284024] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.284024] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.284024] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.312772] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1063e362-e6bc-4ee7-8518-83d8fe445cb4 in Status: UNINITIALIZED for 2s [ 605.875840] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock network-825 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.876210] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "network-825" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.876210] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "network-825" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.877030] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "network-825" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.877030] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.877030] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.877030] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.877347] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.877347] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.877570] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 605.877625] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 605.877732] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 605.877864] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 605.877935] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 605.878031] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 605.878155] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 605.902870] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 605.902870] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 605.903103] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 605.903186] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "network-825" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.903585] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock port-ee2214b3-8e41-453c-8069-1fcbe03119df taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.903847] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "port-ee2214b3-8e41-453c-8069-1fcbe03119df" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.904117] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "port-ee2214b3-8e41-453c-8069-1fcbe03119df" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.904403] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "port-ee2214b3-8e41-453c-8069-1fcbe03119df" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.904520] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ee2214b3-8e41-453c-8069-1fcbe03119df',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.015071] env[65337]: INFO networking_nsxv3.common.synchronization [None req-0a11b9bd-bef4-47ef-959f-031a8eed0519 None None] Enqueued Resource ID: 9b7fff40-5114-4c15-91e0-cc85c2dc5b5b with Priority: HIGHEST for action port [ 606.016014] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b7fff40-5114-4c15-91e0-cc85c2dc5b5b with Priority: HIGHEST for action port [ 606.016291] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-9b7fff40-5114-4c15-91e0-cc85c2dc5b5b taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.016291] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9b7fff40-5114-4c15-91e0-cc85c2dc5b5b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.016369] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9b7fff40-5114-4c15-91e0-cc85c2dc5b5b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.017025] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9b7fff40-5114-4c15-91e0-cc85c2dc5b5b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.017152] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9b7fff40-5114-4c15-91e0-cc85c2dc5b5b',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.321083] env[65337]: INFO networking_nsxv3.common.synchronization [None req-41689035-4243-4d88-aaf9-c577ad9a65fc None None] Enqueued Resource ID: 385a6d63-4e01-400a-8e51-218509e71414 with Priority: HIGHEST for action port [ 606.321864] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 385a6d63-4e01-400a-8e51-218509e71414 with Priority: HIGHEST for action port [ 606.322804] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-385a6d63-4e01-400a-8e51-218509e71414 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.322930] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-385a6d63-4e01-400a-8e51-218509e71414" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.322994] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-385a6d63-4e01-400a-8e51-218509e71414" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.323291] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-385a6d63-4e01-400a-8e51-218509e71414" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.323376] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('385a6d63-4e01-400a-8e51-218509e71414',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.407135] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.407370] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.407494] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.407821] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.407978] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.408142] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Segment Port ee2214b3-8e41-453c-8069-1fcbe03119df not found, creating... [ 606.408404] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.408560] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.408671] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.408879] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.409014] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.409626] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.409821] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.409939] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.410509] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.410509] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.410509] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Resource: SegmentPort with ID: ee2214b3-8e41-453c-8069-1fcbe03119df is going to be created. [ 606.432889] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.432889] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.432889] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.432889] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.433343] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.433343] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "port-ee2214b3-8e41-453c-8069-1fcbe03119df" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.520219] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9b7fff40-5114-4c15-91e0-cc85c2dc5b5b [ 606.520459] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.520656] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.521109] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.521109] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.521109] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.521109] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9b7fff40-5114-4c15-91e0-cc85c2dc5b5b already deleted. [ 606.521295] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9b7fff40-5114-4c15-91e0-cc85c2dc5b5b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.824900] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 385a6d63-4e01-400a-8e51-218509e71414 [ 606.825170] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.825306] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.825370] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.825582] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.825675] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.825798] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:385a6d63-4e01-400a-8e51-218509e71414 already deleted. [ 606.825880] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-385a6d63-4e01-400a-8e51-218509e71414" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.155021] env[65337]: INFO networking_nsxv3.common.synchronization [req-961b388d-837a-4279-a220-6cab99802a66 req-7cee8138-fa24-461f-8515-22776b68e2d4 service nova] Enqueued Resource ID: 4f8577ef-eb55-481e-9197-98761298b164 with Priority: HIGHEST for action security_group_rules [ 607.155021] env[65337]: INFO networking_nsxv3.common.synchronization [req-961b388d-837a-4279-a220-6cab99802a66 req-7cee8138-fa24-461f-8515-22776b68e2d4 service nova] Enqueued Resource ID: 4f8577ef-eb55-481e-9197-98761298b164 with Priority: HIGHEST for action security_group_members [ 607.155021] env[65337]: INFO networking_nsxv3.common.synchronization [req-961b388d-837a-4279-a220-6cab99802a66 req-7cee8138-fa24-461f-8515-22776b68e2d4 service nova] Enqueued Resource ID: ee2214b3-8e41-453c-8069-1fcbe03119df with Priority: HIGHEST for action port [ 607.155021] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f8577ef-eb55-481e-9197-98761298b164 with Priority: HIGHEST for action security_group_rules [ 607.155021] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f8577ef-eb55-481e-9197-98761298b164 with Priority: HIGHEST for action security_group_members [ 607.155021] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee2214b3-8e41-453c-8069-1fcbe03119df with Priority: HIGHEST for action port [ 607.155499] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4f8577ef-eb55-481e-9197-98761298b164 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.155499] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4f8577ef-eb55-481e-9197-98761298b164" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.155499] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4f8577ef-eb55-481e-9197-98761298b164" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.155700] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4f8577ef-eb55-481e-9197-98761298b164" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.155700] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4f8577ef-eb55-481e-9197-98761298b164',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.156952] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f8577ef-eb55-481e-9197-98761298b164 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.157070] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f8577ef-eb55-481e-9197-98761298b164" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.157134] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f8577ef-eb55-481e-9197-98761298b164" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.157303] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f8577ef-eb55-481e-9197-98761298b164" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.157454] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.157546] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.158793] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.160727] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.160727] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.160727] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4f8577ef-eb55-481e-9197-98761298b164',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.160727] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-ee2214b3-8e41-453c-8069-1fcbe03119df taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.161051] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ee2214b3-8e41-453c-8069-1fcbe03119df" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.161051] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ee2214b3-8e41-453c-8069-1fcbe03119df" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.161051] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ee2214b3-8e41-453c-8069-1fcbe03119df" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.161140] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ee2214b3-8e41-453c-8069-1fcbe03119df',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.326579] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1063e362-e6bc-4ee7-8518-83d8fe445cb4 in Status: SUCCESS [ 607.326843] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1063e362-e6bc-4ee7-8518-83d8fe445cb4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.327155] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1063e362-e6bc-4ee7-8518-83d8fe445cb4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.327278] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1063e362-e6bc-4ee7-8518-83d8fe445cb4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.327737] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.327737] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.327737] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.327977] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.327977] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.328592] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1063e362-e6bc-4ee7-8518-83d8fe445cb4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.328666] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1063e362-e6bc-4ee7-8518-83d8fe445cb4',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.663103] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f8577ef-eb55-481e-9197-98761298b164 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.663289] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f8577ef-eb55-481e-9197-98761298b164" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.663429] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4f8577ef-eb55-481e-9197-98761298b164',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.665011] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ee2214b3-8e41-453c-8069-1fcbe03119df with status ACTIVE [ 607.665154] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.665229] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.665291] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.665679] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.665679] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.665927] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.666183] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.666183] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.666272] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.667695] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.667695] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.667695] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.667695] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.667695] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.667695] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.667695] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ee2214b3-8e41-453c-8069-1fcbe03119df is going to be updated. [ 607.689163] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.689320] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.689614] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.690093] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.690292] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.690433] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ee2214b3-8e41-453c-8069-1fcbe03119df" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.831941] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1063e362-e6bc-4ee7-8518-83d8fe445cb4',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.842807] env[65337]: INFO networking_nsxv3.common.synchronization [None req-52456a3d-67b1-4456-8e4c-5b5c51f3e527 None None] Enqueued Resource ID: 4be9dde8-31fd-41c8-911e-097a3a3a3d7f with Priority: HIGHEST for action port [ 607.842807] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4be9dde8-31fd-41c8-911e-097a3a3a3d7f with Priority: HIGHEST for action port [ 607.842807] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-4be9dde8-31fd-41c8-911e-097a3a3a3d7f taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.842807] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4be9dde8-31fd-41c8-911e-097a3a3a3d7f" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.842807] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4be9dde8-31fd-41c8-911e-097a3a3a3d7f" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.842807] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4be9dde8-31fd-41c8-911e-097a3a3a3d7f" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.842807] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4be9dde8-31fd-41c8-911e-097a3a3a3d7f',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.168885] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4f8577ef-eb55-481e-9197-98761298b164',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.340765] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1063e362-e6bc-4ee7-8518-83d8fe445cb4: rpc.has_security_group_logging(os_id): False [ 608.346082] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4be9dde8-31fd-41c8-911e-097a3a3a3d7f [ 608.346082] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.346082] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.346082] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.346543] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.346648] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.346732] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4be9dde8-31fd-41c8-911e-097a3a3a3d7f already deleted. [ 608.346811] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4be9dde8-31fd-41c8-911e-097a3a3a3d7f" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.362843] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.363085] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.363085] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.363280] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.363369] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.364253] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.364507] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.364507] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.364990] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.364990] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.364990] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1063e362-e6bc-4ee7-8518-83d8fe445cb4 is going to be created. [ 608.426371] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.426540] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.426582] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.427386] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.428782] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.443821] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1063e362-e6bc-4ee7-8518-83d8fe445cb4 in Status: IN_PROGRESS for 2s [ 608.621810] env[65337]: INFO networking_nsxv3.common.synchronization [req-f7a7665b-d65c-4d5e-8d07-a8ba4a3efcdd req-c1573307-e821-476e-9047-61b9190e6298 tempest-ServerActionsTestOtherB-648353996 tempest-ServerActionsTestOtherB-648353996-project-member] Enqueued Resource ID: d4ff60fe-3407-42aa-b33c-6254779ad495 with Priority: HIGHEST for action security_group_members [ 608.621810] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4ff60fe-3407-42aa-b33c-6254779ad495 with Priority: HIGHEST for action security_group_members [ 608.621921] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4ff60fe-3407-42aa-b33c-6254779ad495 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.622651] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4ff60fe-3407-42aa-b33c-6254779ad495" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.622738] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4ff60fe-3407-42aa-b33c-6254779ad495" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.622963] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4ff60fe-3407-42aa-b33c-6254779ad495" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.623126] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.623237] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.623323] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.623549] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.623606] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.623672] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d4ff60fe-3407-42aa-b33c-6254779ad495',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.672425] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.672923] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.672923] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.672923] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.673112] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.673112] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f8577ef-eb55-481e-9197-98761298b164 is going to be created. [ 608.701209] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.701375] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.701451] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.701692] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.701847] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.715181] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f8577ef-eb55-481e-9197-98761298b164 in Status: UNINITIALIZED for 2s [ 609.126242] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.126403] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.126475] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.126683] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.126780] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.126999] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.127110] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.127168] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.127322] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.127397] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.127507] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d4ff60fe-3407-42aa-b33c-6254779ad495 already deleted. [ 609.127581] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4ff60fe-3407-42aa-b33c-6254779ad495" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.266110] env[65337]: INFO networking_nsxv3.common.synchronization [None req-da0d91cc-d7dc-4822-b2bb-8cefd5346eb1 None None] Enqueued Resource ID: ab528774-3af2-4059-acf9-a2acf9a3c41f with Priority: HIGHEST for action port [ 609.267706] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab528774-3af2-4059-acf9-a2acf9a3c41f with Priority: HIGHEST for action port [ 609.268119] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-ab528774-3af2-4059-acf9-a2acf9a3c41f taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.268412] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ab528774-3af2-4059-acf9-a2acf9a3c41f" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.268476] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ab528774-3af2-4059-acf9-a2acf9a3c41f" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.268845] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ab528774-3af2-4059-acf9-a2acf9a3c41f" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.268845] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ab528774-3af2-4059-acf9-a2acf9a3c41f',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.386020] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock network-574 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.386020] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "network-574" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.386020] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "network-574" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.386020] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "network-574" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.386020] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.386020] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.386020] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.386020] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.386020] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.386020] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 609.386020] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 609.386020] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 609.386020] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 609.386557] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 609.386557] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 609.386557] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 609.404829] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 609.405908] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 609.405908] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 609.405908] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "network-574" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.405908] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock port-f2319fa9-fe59-4796-80cd-16ab5e963c08 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.405908] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "port-f2319fa9-fe59-4796-80cd-16ab5e963c08" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.406257] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "port-f2319fa9-fe59-4796-80cd-16ab5e963c08" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.406257] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "port-f2319fa9-fe59-4796-80cd-16ab5e963c08" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.406374] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f2319fa9-fe59-4796-80cd-16ab5e963c08',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.771308] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ab528774-3af2-4059-acf9-a2acf9a3c41f [ 609.772226] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.772226] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.772226] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.772226] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.772226] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.772519] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ab528774-3af2-4059-acf9-a2acf9a3c41f already deleted. [ 609.772519] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ab528774-3af2-4059-acf9-a2acf9a3c41f" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.910831] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.910831] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.910831] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.910831] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.910831] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.910831] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Segment Port f2319fa9-fe59-4796-80cd-16ab5e963c08 not found, creating... [ 609.910831] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.910831] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.910831] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.910831] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.911317] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.912780] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.913207] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.913207] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.913316] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.913448] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.914368] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Resource: SegmentPort with ID: f2319fa9-fe59-4796-80cd-16ab5e963c08 is going to be created. [ 609.937347] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.937546] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.937724] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.937941] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.938903] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.939771] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "port-f2319fa9-fe59-4796-80cd-16ab5e963c08" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.126127] env[65337]: INFO networking_nsxv3.common.synchronization [None req-e4125f99-ef17-415c-bfe6-b94bbee619d5 None None] Enqueued Resource ID: cdeee96d-12d3-41c9-b66e-8b35f7125ce0 with Priority: HIGHEST for action port [ 610.126127] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cdeee96d-12d3-41c9-b66e-8b35f7125ce0 with Priority: HIGHEST for action port [ 610.126127] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-cdeee96d-12d3-41c9-b66e-8b35f7125ce0 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.126127] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cdeee96d-12d3-41c9-b66e-8b35f7125ce0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.126127] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cdeee96d-12d3-41c9-b66e-8b35f7125ce0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.126127] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cdeee96d-12d3-41c9-b66e-8b35f7125ce0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.126127] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cdeee96d-12d3-41c9-b66e-8b35f7125ce0',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.458271] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1063e362-e6bc-4ee7-8518-83d8fe445cb4 in Status: SUCCESS [ 610.458699] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1063e362-e6bc-4ee7-8518-83d8fe445cb4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.628244] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cdeee96d-12d3-41c9-b66e-8b35f7125ce0 [ 610.629529] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.629698] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.629766] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.630027] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.630113] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.630209] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cdeee96d-12d3-41c9-b66e-8b35f7125ce0 already deleted. [ 610.630292] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cdeee96d-12d3-41c9-b66e-8b35f7125ce0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.667807] env[65337]: INFO networking_nsxv3.common.synchronization [req-f7a7665b-d65c-4d5e-8d07-a8ba4a3efcdd req-99f6c8c2-ed32-49d6-b627-ad3525d68b2e service nova] Enqueued Resource ID: d4ff60fe-3407-42aa-b33c-6254779ad495 with Priority: HIGHEST for action security_group_rules [ 610.667807] env[65337]: INFO networking_nsxv3.common.synchronization [req-f7a7665b-d65c-4d5e-8d07-a8ba4a3efcdd req-99f6c8c2-ed32-49d6-b627-ad3525d68b2e service nova] Enqueued Resource ID: d4ff60fe-3407-42aa-b33c-6254779ad495 with Priority: HIGHEST for action security_group_members [ 610.667807] env[65337]: INFO networking_nsxv3.common.synchronization [req-f7a7665b-d65c-4d5e-8d07-a8ba4a3efcdd req-99f6c8c2-ed32-49d6-b627-ad3525d68b2e service nova] Enqueued Resource ID: f2319fa9-fe59-4796-80cd-16ab5e963c08 with Priority: HIGHEST for action port [ 610.667981] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4ff60fe-3407-42aa-b33c-6254779ad495 with Priority: HIGHEST for action security_group_rules [ 610.669909] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4ff60fe-3407-42aa-b33c-6254779ad495 with Priority: HIGHEST for action security_group_members [ 610.670047] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2319fa9-fe59-4796-80cd-16ab5e963c08 with Priority: HIGHEST for action port [ 610.671140] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d4ff60fe-3407-42aa-b33c-6254779ad495 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.671140] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d4ff60fe-3407-42aa-b33c-6254779ad495" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.671140] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d4ff60fe-3407-42aa-b33c-6254779ad495" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.671460] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d4ff60fe-3407-42aa-b33c-6254779ad495" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.671460] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d4ff60fe-3407-42aa-b33c-6254779ad495',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.672595] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4ff60fe-3407-42aa-b33c-6254779ad495 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.672595] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4ff60fe-3407-42aa-b33c-6254779ad495" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.672595] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4ff60fe-3407-42aa-b33c-6254779ad495" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.672595] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4ff60fe-3407-42aa-b33c-6254779ad495" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.672794] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.672846] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.672877] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.673140] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.673140] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.673222] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d4ff60fe-3407-42aa-b33c-6254779ad495',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.674019] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-f2319fa9-fe59-4796-80cd-16ab5e963c08 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.674132] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f2319fa9-fe59-4796-80cd-16ab5e963c08" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.674195] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f2319fa9-fe59-4796-80cd-16ab5e963c08" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.674346] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f2319fa9-fe59-4796-80cd-16ab5e963c08" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.674417] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f2319fa9-fe59-4796-80cd-16ab5e963c08',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.727347] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f8577ef-eb55-481e-9197-98761298b164 in Status: SUCCESS [ 610.727565] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f8577ef-eb55-481e-9197-98761298b164" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.727703] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f8577ef-eb55-481e-9197-98761298b164" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.727926] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f8577ef-eb55-481e-9197-98761298b164" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.728122] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.728240] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.728304] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.728494] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.728604] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.728763] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f8577ef-eb55-481e-9197-98761298b164" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.728797] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4f8577ef-eb55-481e-9197-98761298b164',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.176895] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4ff60fe-3407-42aa-b33c-6254779ad495 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.177100] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4ff60fe-3407-42aa-b33c-6254779ad495" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.177281] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d4ff60fe-3407-42aa-b33c-6254779ad495',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.178186] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f2319fa9-fe59-4796-80cd-16ab5e963c08 with status ACTIVE [ 611.178366] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.178479] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.178546] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.178773] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.178867] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.179540] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.179663] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.179730] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.181107] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.181107] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.181215] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.181314] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.181410] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.181561] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.181637] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.181721] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f2319fa9-fe59-4796-80cd-16ab5e963c08 is going to be updated. [ 611.205891] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.205891] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.205891] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.206104] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.206140] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.206278] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f2319fa9-fe59-4796-80cd-16ab5e963c08" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.231162] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4f8577ef-eb55-481e-9197-98761298b164',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.686493] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d4ff60fe-3407-42aa-b33c-6254779ad495',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.700563] env[65337]: INFO networking_nsxv3.common.synchronization [None req-3958b4e4-ee9f-4be4-8b96-3f6f164c72ac None None] Enqueued Resource ID: 2cb8d38e-7652-4d9f-8fd4-3c369d6a4209 with Priority: HIGHEST for action port [ 611.701748] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2cb8d38e-7652-4d9f-8fd4-3c369d6a4209 with Priority: HIGHEST for action port [ 611.702459] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-2cb8d38e-7652-4d9f-8fd4-3c369d6a4209 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.702459] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2cb8d38e-7652-4d9f-8fd4-3c369d6a4209" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.702625] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2cb8d38e-7652-4d9f-8fd4-3c369d6a4209" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.702920] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2cb8d38e-7652-4d9f-8fd4-3c369d6a4209" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.702920] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2cb8d38e-7652-4d9f-8fd4-3c369d6a4209',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.733167] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4f8577ef-eb55-481e-9197-98761298b164: rpc.has_security_group_logging(os_id): False [ 611.752849] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.753101] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.753101] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.753312] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.753405] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.753808] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.753808] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.753955] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.754011] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.754092] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.754172] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4f8577ef-eb55-481e-9197-98761298b164 is going to be created. [ 611.819948] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.820234] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.820234] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.820428] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.820609] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.833054] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4f8577ef-eb55-481e-9197-98761298b164 in Status: IN_PROGRESS for 2s [ 612.194031] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.194031] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.194031] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.194031] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.194031] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.194031] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d4ff60fe-3407-42aa-b33c-6254779ad495 is going to be created. [ 612.207263] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2cb8d38e-7652-4d9f-8fd4-3c369d6a4209 [ 612.207479] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.207609] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.207673] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.207877] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.207964] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.208070] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2cb8d38e-7652-4d9f-8fd4-3c369d6a4209 already deleted. [ 612.208150] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2cb8d38e-7652-4d9f-8fd4-3c369d6a4209" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.226228] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.226387] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.226433] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.226637] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.226794] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.241221] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4ff60fe-3407-42aa-b33c-6254779ad495 in Status: UNINITIALIZED for 2s [ 612.645705] env[65337]: INFO networking_nsxv3.common.synchronization [None req-cf6f39ca-51e1-42ec-a36e-1663c61fdfed None None] Enqueued Resource ID: 5e5ceab7-b9d2-42f4-9244-2d12eee3ee40 with Priority: HIGHEST for action port [ 612.646224] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e5ceab7-b9d2-42f4-9244-2d12eee3ee40 with Priority: HIGHEST for action port [ 612.648400] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-5e5ceab7-b9d2-42f4-9244-2d12eee3ee40 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.648550] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5e5ceab7-b9d2-42f4-9244-2d12eee3ee40" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.648598] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5e5ceab7-b9d2-42f4-9244-2d12eee3ee40" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.648859] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5e5ceab7-b9d2-42f4-9244-2d12eee3ee40" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.648941] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5e5ceab7-b9d2-42f4-9244-2d12eee3ee40',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.953369] env[65337]: INFO networking_nsxv3.common.synchronization [req-68bdb94d-5d47-4e81-8434-468b3cb614c3 req-de02b58a-ab98-4b80-88a6-a295bfd7af62 tempest-AttachInterfacesUnderV243Test-1010804015 tempest-AttachInterfacesUnderV243Test-1010804015-project-member] Enqueued Resource ID: 5afc8a2a-3bb1-4c3e-a10b-0941514929b4 with Priority: HIGHEST for action security_group_members [ 612.954057] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5afc8a2a-3bb1-4c3e-a10b-0941514929b4 with Priority: HIGHEST for action security_group_members [ 612.954906] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-5afc8a2a-3bb1-4c3e-a10b-0941514929b4 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.955130] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5afc8a2a-3bb1-4c3e-a10b-0941514929b4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.955564] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5afc8a2a-3bb1-4c3e-a10b-0941514929b4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.955881] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5afc8a2a-3bb1-4c3e-a10b-0941514929b4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.956299] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.956299] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.956428] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.956564] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.956687] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.956812] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5afc8a2a-3bb1-4c3e-a10b-0941514929b4',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.153977] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5e5ceab7-b9d2-42f4-9244-2d12eee3ee40 [ 613.153977] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.153977] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.153977] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.153977] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.153977] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.153977] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5e5ceab7-b9d2-42f4-9244-2d12eee3ee40 already deleted. [ 613.153977] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5e5ceab7-b9d2-42f4-9244-2d12eee3ee40" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.460290] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.462110] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.462110] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.462110] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.462110] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.462110] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.462110] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.462110] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.462110] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.462110] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.462110] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5afc8a2a-3bb1-4c3e-a10b-0941514929b4 already deleted. [ 613.462110] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5afc8a2a-3bb1-4c3e-a10b-0941514929b4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.574586] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock network-526 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.574771] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "network-526" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.574887] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "network-526" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.575241] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "network-526" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.575512] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.575648] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.575763] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.575972] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.577905] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.578638] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 613.578638] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 613.578638] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 613.579766] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 613.579766] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 613.579766] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 613.579766] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 613.600329] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 613.600504] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 613.600647] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 613.601076] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "network-526" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.601489] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock port-f8737cbe-9807-4a6f-ae30-f63a1d167ad5 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.601715] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "port-f8737cbe-9807-4a6f-ae30-f63a1d167ad5" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.601835] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "port-f8737cbe-9807-4a6f-ae30-f63a1d167ad5" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.602211] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "port-f8737cbe-9807-4a6f-ae30-f63a1d167ad5" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.602390] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f8737cbe-9807-4a6f-ae30-f63a1d167ad5',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.849113] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4f8577ef-eb55-481e-9197-98761298b164 in Status: SUCCESS [ 613.849332] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4f8577ef-eb55-481e-9197-98761298b164" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.861066] env[65337]: INFO networking_nsxv3.common.synchronization [None req-9f0f1910-6de4-49a9-9333-94718f0991d4 None None] Enqueued Resource ID: 6b29ce97-c558-4bf2-8ecd-a18bc6fd2c3c with Priority: HIGHEST for action port [ 613.861066] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b29ce97-c558-4bf2-8ecd-a18bc6fd2c3c with Priority: HIGHEST for action port [ 613.861503] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-6b29ce97-c558-4bf2-8ecd-a18bc6fd2c3c taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.861503] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6b29ce97-c558-4bf2-8ecd-a18bc6fd2c3c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.861503] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6b29ce97-c558-4bf2-8ecd-a18bc6fd2c3c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.861882] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6b29ce97-c558-4bf2-8ecd-a18bc6fd2c3c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.861882] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6b29ce97-c558-4bf2-8ecd-a18bc6fd2c3c',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.105722] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.106077] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.106268] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.106579] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.107526] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.107526] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Segment Port f8737cbe-9807-4a6f-ae30-f63a1d167ad5 not found, creating... [ 614.107526] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.107526] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.107526] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.107743] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.107775] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.108196] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.108196] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.108325] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.108696] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.108696] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.108759] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Resource: SegmentPort with ID: f8737cbe-9807-4a6f-ae30-f63a1d167ad5 is going to be created. [ 614.131818] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.132131] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.132207] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.132422] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.132638] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.132852] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "port-f8737cbe-9807-4a6f-ae30-f63a1d167ad5" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.258965] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4ff60fe-3407-42aa-b33c-6254779ad495 in Status: SUCCESS [ 614.259254] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4ff60fe-3407-42aa-b33c-6254779ad495" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.259502] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4ff60fe-3407-42aa-b33c-6254779ad495" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.259618] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4ff60fe-3407-42aa-b33c-6254779ad495" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.259847] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.260304] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.260304] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.260304] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.260486] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.260486] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4ff60fe-3407-42aa-b33c-6254779ad495" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.260486] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d4ff60fe-3407-42aa-b33c-6254779ad495',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.363674] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6b29ce97-c558-4bf2-8ecd-a18bc6fd2c3c [ 614.363927] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.364078] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.364146] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.364352] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.364440] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.364540] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6b29ce97-c558-4bf2-8ecd-a18bc6fd2c3c already deleted. [ 614.364679] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6b29ce97-c558-4bf2-8ecd-a18bc6fd2c3c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.763237] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d4ff60fe-3407-42aa-b33c-6254779ad495',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.974148] env[65337]: INFO networking_nsxv3.common.synchronization [None req-83abbcc0-8f86-44c1-a4a1-f13e8e75d22c tempest-ServersWithSpecificFlavorTestJSON-1708740375 tempest-ServersWithSpecificFlavorTestJSON-1708740375-project-member] Enqueued Resource ID: c26a679a-9c5d-4a72-b91b-bd7f21348ea0 with Priority: HIGHEST for action security_group_rules [ 614.974749] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c26a679a-9c5d-4a72-b91b-bd7f21348ea0 with Priority: HIGHEST for action security_group_rules [ 614.975068] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c26a679a-9c5d-4a72-b91b-bd7f21348ea0 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.975186] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c26a679a-9c5d-4a72-b91b-bd7f21348ea0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.975412] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c26a679a-9c5d-4a72-b91b-bd7f21348ea0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.975597] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c26a679a-9c5d-4a72-b91b-bd7f21348ea0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.975685] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c26a679a-9c5d-4a72-b91b-bd7f21348ea0',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.221775] env[65337]: INFO networking_nsxv3.common.synchronization [req-68bdb94d-5d47-4e81-8434-468b3cb614c3 req-d98f03f5-397d-4e2d-8b6f-fd5ea2115277 service nova] Enqueued Resource ID: 5afc8a2a-3bb1-4c3e-a10b-0941514929b4 with Priority: HIGHEST for action security_group_rules [ 615.221775] env[65337]: INFO networking_nsxv3.common.synchronization [req-68bdb94d-5d47-4e81-8434-468b3cb614c3 req-d98f03f5-397d-4e2d-8b6f-fd5ea2115277 service nova] Enqueued Resource ID: 5afc8a2a-3bb1-4c3e-a10b-0941514929b4 with Priority: HIGHEST for action security_group_members [ 615.221775] env[65337]: INFO networking_nsxv3.common.synchronization [req-68bdb94d-5d47-4e81-8434-468b3cb614c3 req-d98f03f5-397d-4e2d-8b6f-fd5ea2115277 service nova] Enqueued Resource ID: f8737cbe-9807-4a6f-ae30-f63a1d167ad5 with Priority: HIGHEST for action port [ 615.221775] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5afc8a2a-3bb1-4c3e-a10b-0941514929b4 with Priority: HIGHEST for action security_group_rules [ 615.221775] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5afc8a2a-3bb1-4c3e-a10b-0941514929b4 with Priority: HIGHEST for action security_group_members [ 615.222335] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8737cbe-9807-4a6f-ae30-f63a1d167ad5 with Priority: HIGHEST for action port [ 615.222335] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5afc8a2a-3bb1-4c3e-a10b-0941514929b4 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.223024] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5afc8a2a-3bb1-4c3e-a10b-0941514929b4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.223024] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5afc8a2a-3bb1-4c3e-a10b-0941514929b4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.223024] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5afc8a2a-3bb1-4c3e-a10b-0941514929b4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.223331] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5afc8a2a-3bb1-4c3e-a10b-0941514929b4',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.226277] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-5afc8a2a-3bb1-4c3e-a10b-0941514929b4 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.226418] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5afc8a2a-3bb1-4c3e-a10b-0941514929b4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.226504] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5afc8a2a-3bb1-4c3e-a10b-0941514929b4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.226737] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5afc8a2a-3bb1-4c3e-a10b-0941514929b4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.226872] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.227103] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.227103] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.228305] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.228305] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.228305] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5afc8a2a-3bb1-4c3e-a10b-0941514929b4',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.231142] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-f8737cbe-9807-4a6f-ae30-f63a1d167ad5 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.231348] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f8737cbe-9807-4a6f-ae30-f63a1d167ad5" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.231348] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f8737cbe-9807-4a6f-ae30-f63a1d167ad5" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.231524] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f8737cbe-9807-4a6f-ae30-f63a1d167ad5" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.231588] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f8737cbe-9807-4a6f-ae30-f63a1d167ad5',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.266496] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d4ff60fe-3407-42aa-b33c-6254779ad495: rpc.has_security_group_logging(os_id): False [ 615.287804] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.288067] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.288134] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.288328] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.288417] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.288651] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.288746] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.288804] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.288958] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.289055] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.289139] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d4ff60fe-3407-42aa-b33c-6254779ad495 is going to be created. [ 615.360460] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.360663] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.360663] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.360874] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.361068] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.396176] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d4ff60fe-3407-42aa-b33c-6254779ad495 in Status: IN_PROGRESS for 2s [ 615.497728] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.498040] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.498040] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.498193] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.498307] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.498411] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c26a679a-9c5d-4a72-b91b-bd7f21348ea0 already deleted. [ 615.498522] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c26a679a-9c5d-4a72-b91b-bd7f21348ea0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.546851] env[65337]: INFO networking_nsxv3.common.synchronization [None req-f3006a7a-f61d-44dd-9f01-18d62614fc3c None None] Enqueued Resource ID: e1896a78-33c4-47c0-90a1-29345089877d with Priority: HIGHEST for action port [ 615.548019] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1896a78-33c4-47c0-90a1-29345089877d with Priority: HIGHEST for action port [ 615.548585] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-e1896a78-33c4-47c0-90a1-29345089877d taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.548809] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e1896a78-33c4-47c0-90a1-29345089877d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.548945] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e1896a78-33c4-47c0-90a1-29345089877d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.549413] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e1896a78-33c4-47c0-90a1-29345089877d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.549585] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e1896a78-33c4-47c0-90a1-29345089877d',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.733928] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-5afc8a2a-3bb1-4c3e-a10b-0941514929b4 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.734039] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5afc8a2a-3bb1-4c3e-a10b-0941514929b4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.737843] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5afc8a2a-3bb1-4c3e-a10b-0941514929b4',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.738790] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f8737cbe-9807-4a6f-ae30-f63a1d167ad5 with status ACTIVE [ 615.738993] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.739132] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.739198] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.739408] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.739497] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.739694] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.739803] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.739867] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.740029] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.740099] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.740283] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.740373] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.740457] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.740564] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.740641] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.740723] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f8737cbe-9807-4a6f-ae30-f63a1d167ad5 is going to be updated. [ 615.767954] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.768207] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.768291] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.768507] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.768645] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.768797] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f8737cbe-9807-4a6f-ae30-f63a1d167ad5" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.850778] env[65337]: INFO networking_nsxv3.common.synchronization [None req-6d2ffbe5-490c-4a53-bc4f-28bbb1625139 tempest-ServersWithSpecificFlavorTestJSON-1708740375 tempest-ServersWithSpecificFlavorTestJSON-1708740375-project-member] Enqueued Resource ID: c26a679a-9c5d-4a72-b91b-bd7f21348ea0 with Priority: HIGHEST for action security_group_rules [ 615.851381] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c26a679a-9c5d-4a72-b91b-bd7f21348ea0 with Priority: HIGHEST for action security_group_rules [ 615.851735] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c26a679a-9c5d-4a72-b91b-bd7f21348ea0 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.851853] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c26a679a-9c5d-4a72-b91b-bd7f21348ea0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.851910] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c26a679a-9c5d-4a72-b91b-bd7f21348ea0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.853581] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c26a679a-9c5d-4a72-b91b-bd7f21348ea0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.853581] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c26a679a-9c5d-4a72-b91b-bd7f21348ea0',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.053456] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e1896a78-33c4-47c0-90a1-29345089877d [ 616.053768] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.054167] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.054237] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.054455] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.054563] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.054659] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e1896a78-33c4-47c0-90a1-29345089877d already deleted. [ 616.054740] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e1896a78-33c4-47c0-90a1-29345089877d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.243881] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5afc8a2a-3bb1-4c3e-a10b-0941514929b4',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.301602] env[65337]: INFO networking_nsxv3.common.synchronization [None req-c163d059-644f-4141-b17f-16da669246a4 None None] Enqueued Resource ID: 262964f4-babf-440f-99a8-8773f6aa62a1 with Priority: HIGHEST for action port [ 616.302284] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 262964f4-babf-440f-99a8-8773f6aa62a1 with Priority: HIGHEST for action port [ 616.302765] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-262964f4-babf-440f-99a8-8773f6aa62a1 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.302765] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-262964f4-babf-440f-99a8-8773f6aa62a1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.302901] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-262964f4-babf-440f-99a8-8773f6aa62a1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.303134] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-262964f4-babf-440f-99a8-8773f6aa62a1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.303271] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('262964f4-babf-440f-99a8-8773f6aa62a1',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.377336] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.377336] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.377336] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.377336] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.377336] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.377336] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c26a679a-9c5d-4a72-b91b-bd7f21348ea0 already deleted. [ 616.377336] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c26a679a-9c5d-4a72-b91b-bd7f21348ea0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.746927] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.747110] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.747173] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.747392] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.747518] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.747571] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5afc8a2a-3bb1-4c3e-a10b-0941514929b4 is going to be created. [ 616.775278] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.775278] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.775278] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.775953] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.776193] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.790415] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5afc8a2a-3bb1-4c3e-a10b-0941514929b4 in Status: UNINITIALIZED for 2s [ 616.807310] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 262964f4-babf-440f-99a8-8773f6aa62a1 [ 616.807555] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.807722] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.807774] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.807974] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.808070] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.808164] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:262964f4-babf-440f-99a8-8773f6aa62a1 already deleted. [ 616.808245] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-262964f4-babf-440f-99a8-8773f6aa62a1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.240408] env[65337]: INFO networking_nsxv3.common.synchronization [None req-6fc40756-5a89-4b1e-ab70-720aaf71c1da None None] Enqueued Resource ID: 6884d9fb-c53c-46af-b016-53b91eab1db0 with Priority: HIGHEST for action port [ 617.242881] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6884d9fb-c53c-46af-b016-53b91eab1db0 with Priority: HIGHEST for action port [ 617.242881] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-6884d9fb-c53c-46af-b016-53b91eab1db0 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.242881] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6884d9fb-c53c-46af-b016-53b91eab1db0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.242881] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6884d9fb-c53c-46af-b016-53b91eab1db0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.242881] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6884d9fb-c53c-46af-b016-53b91eab1db0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.242881] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6884d9fb-c53c-46af-b016-53b91eab1db0',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.329455] env[65337]: INFO networking_nsxv3.common.synchronization [None req-f000d5bf-4d10-43e9-b550-70b15cf4bc27 None None] Enqueued Resource ID: 9ca8309e-89f8-4b03-925c-9669ab0c7203 with Priority: HIGHEST for action port [ 617.330083] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ca8309e-89f8-4b03-925c-9669ab0c7203 with Priority: HIGHEST for action port [ 617.330375] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-9ca8309e-89f8-4b03-925c-9669ab0c7203 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.330780] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9ca8309e-89f8-4b03-925c-9669ab0c7203" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.330780] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9ca8309e-89f8-4b03-925c-9669ab0c7203" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.330780] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9ca8309e-89f8-4b03-925c-9669ab0c7203" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.330941] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9ca8309e-89f8-4b03-925c-9669ab0c7203',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.412313] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d4ff60fe-3407-42aa-b33c-6254779ad495 in Status: SUCCESS [ 617.412542] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d4ff60fe-3407-42aa-b33c-6254779ad495" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.748029] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6884d9fb-c53c-46af-b016-53b91eab1db0 [ 617.749111] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.749111] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.749111] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.749111] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.749298] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.749581] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6884d9fb-c53c-46af-b016-53b91eab1db0 already deleted. [ 617.749924] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6884d9fb-c53c-46af-b016-53b91eab1db0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.834869] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9ca8309e-89f8-4b03-925c-9669ab0c7203 [ 617.835031] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.835241] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.835317] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.835610] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.835683] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.835802] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9ca8309e-89f8-4b03-925c-9669ab0c7203 already deleted. [ 617.836054] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9ca8309e-89f8-4b03-925c-9669ab0c7203" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.764104] env[65337]: INFO networking_nsxv3.common.synchronization [req-9830cf51-ef7e-4baa-87b6-3a76e503d65f req-b4b80436-b40c-461b-b626-507efbaa5f8e tempest-ServerDiagnosticsNegativeTest-1110258397 tempest-ServerDiagnosticsNegativeTest-1110258397-project-member] Enqueued Resource ID: 058c2139-5b77-4965-b2d8-ecc46af22480 with Priority: HIGHEST for action security_group_members [ 618.764693] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 058c2139-5b77-4965-b2d8-ecc46af22480 with Priority: HIGHEST for action security_group_members [ 618.765056] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-058c2139-5b77-4965-b2d8-ecc46af22480 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.765210] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-058c2139-5b77-4965-b2d8-ecc46af22480" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.765262] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-058c2139-5b77-4965-b2d8-ecc46af22480" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.765645] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-058c2139-5b77-4965-b2d8-ecc46af22480" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.765706] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.765866] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.765908] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.766109] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.766212] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.766319] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('058c2139-5b77-4965-b2d8-ecc46af22480',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.800692] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5afc8a2a-3bb1-4c3e-a10b-0941514929b4 in Status: SUCCESS [ 618.800962] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5afc8a2a-3bb1-4c3e-a10b-0941514929b4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.801222] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5afc8a2a-3bb1-4c3e-a10b-0941514929b4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.801555] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5afc8a2a-3bb1-4c3e-a10b-0941514929b4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.801774] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.801896] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.801967] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.802217] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.802371] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.802410] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5afc8a2a-3bb1-4c3e-a10b-0941514929b4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.802493] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5afc8a2a-3bb1-4c3e-a10b-0941514929b4',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.133079] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock network-292 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.133214] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "network-292" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.133276] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "network-292" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.134361] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "network-292" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.134420] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.134875] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.135043] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.135283] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.136134] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.136134] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 619.136134] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 619.136134] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 619.136134] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 619.136354] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 619.136354] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 619.136459] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 619.160211] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 619.160211] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 619.160211] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 619.160211] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "network-292" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.160211] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock port-085cd66a-0a2c-4190-bd53-796d0d09ca76 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.160211] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "port-085cd66a-0a2c-4190-bd53-796d0d09ca76" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.160211] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "port-085cd66a-0a2c-4190-bd53-796d0d09ca76" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.160211] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "port-085cd66a-0a2c-4190-bd53-796d0d09ca76" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.160211] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('085cd66a-0a2c-4190-bd53-796d0d09ca76',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.269567] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.269894] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.269993] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.270318] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.270477] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.270785] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.270958] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.271047] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.271690] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.271690] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.271690] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 058c2139-5b77-4965-b2d8-ecc46af22480 already deleted. [ 619.271690] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-058c2139-5b77-4965-b2d8-ecc46af22480" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.279872] env[65337]: INFO networking_nsxv3.common.synchronization [None req-9ea392f1-afab-44f7-b378-72940b61c703 None None] Enqueued Resource ID: 5c096f03-a4b8-475a-8d8c-39f4cb282abd with Priority: HIGHEST for action port [ 619.280440] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c096f03-a4b8-475a-8d8c-39f4cb282abd with Priority: HIGHEST for action port [ 619.280738] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-5c096f03-a4b8-475a-8d8c-39f4cb282abd taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.280860] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5c096f03-a4b8-475a-8d8c-39f4cb282abd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.280953] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5c096f03-a4b8-475a-8d8c-39f4cb282abd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.281462] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5c096f03-a4b8-475a-8d8c-39f4cb282abd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.281631] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5c096f03-a4b8-475a-8d8c-39f4cb282abd',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.305212] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5afc8a2a-3bb1-4c3e-a10b-0941514929b4',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.414229] env[65337]: INFO networking_nsxv3.common.synchronization [None req-2c044715-1019-4f61-8b82-eb1ed8f0d22e None None] Enqueued Resource ID: f6709619-ec23-4c4b-b0e6-2caf8d65dd52 with Priority: HIGHEST for action port [ 619.414229] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6709619-ec23-4c4b-b0e6-2caf8d65dd52 with Priority: HIGHEST for action port [ 619.414229] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-f6709619-ec23-4c4b-b0e6-2caf8d65dd52 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.414229] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f6709619-ec23-4c4b-b0e6-2caf8d65dd52" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.414229] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f6709619-ec23-4c4b-b0e6-2caf8d65dd52" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.415588] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f6709619-ec23-4c4b-b0e6-2caf8d65dd52" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.415793] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f6709619-ec23-4c4b-b0e6-2caf8d65dd52',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.665665] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.665883] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.666091] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.666337] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.666530] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.666755] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Segment Port 085cd66a-0a2c-4190-bd53-796d0d09ca76 not found, creating... [ 619.667081] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.667314] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.667367] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.667561] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.667754] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.669514] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.669908] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.669908] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.670985] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.670985] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.670985] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Resource: SegmentPort with ID: 085cd66a-0a2c-4190-bd53-796d0d09ca76 is going to be created. [ 619.697107] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.697342] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.697457] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.697816] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.698067] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.698226] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "port-085cd66a-0a2c-4190-bd53-796d0d09ca76" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.784431] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5c096f03-a4b8-475a-8d8c-39f4cb282abd [ 619.784431] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.787572] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.787572] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.787572] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.787572] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.787572] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5c096f03-a4b8-475a-8d8c-39f4cb282abd already deleted. [ 619.787572] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5c096f03-a4b8-475a-8d8c-39f4cb282abd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.807383] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5afc8a2a-3bb1-4c3e-a10b-0941514929b4: rpc.has_security_group_logging(os_id): False [ 619.829911] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.830073] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.830209] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.830703] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.830703] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.830703] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.833704] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.833704] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.833704] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.833704] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.833704] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5afc8a2a-3bb1-4c3e-a10b-0941514929b4 is going to be created. [ 619.911878] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.911878] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.911878] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.911878] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.912150] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.919418] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f6709619-ec23-4c4b-b0e6-2caf8d65dd52 [ 619.921118] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.921118] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.921118] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.921118] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.921118] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.921118] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f6709619-ec23-4c4b-b0e6-2caf8d65dd52 already deleted. [ 619.921118] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f6709619-ec23-4c4b-b0e6-2caf8d65dd52" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.926388] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5afc8a2a-3bb1-4c3e-a10b-0941514929b4 in Status: IN_PROGRESS for 2s [ 620.439400] env[65337]: INFO networking_nsxv3.common.synchronization [req-9830cf51-ef7e-4baa-87b6-3a76e503d65f req-a2ff0bf2-3e79-4fd2-89ae-fe31e5f1fd59 service nova] Enqueued Resource ID: 058c2139-5b77-4965-b2d8-ecc46af22480 with Priority: HIGHEST for action security_group_rules [ 620.439563] env[65337]: INFO networking_nsxv3.common.synchronization [req-9830cf51-ef7e-4baa-87b6-3a76e503d65f req-a2ff0bf2-3e79-4fd2-89ae-fe31e5f1fd59 service nova] Enqueued Resource ID: 058c2139-5b77-4965-b2d8-ecc46af22480 with Priority: HIGHEST for action security_group_members [ 620.439691] env[65337]: INFO networking_nsxv3.common.synchronization [req-9830cf51-ef7e-4baa-87b6-3a76e503d65f req-a2ff0bf2-3e79-4fd2-89ae-fe31e5f1fd59 service nova] Enqueued Resource ID: 085cd66a-0a2c-4190-bd53-796d0d09ca76 with Priority: HIGHEST for action port [ 620.440239] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 058c2139-5b77-4965-b2d8-ecc46af22480 with Priority: HIGHEST for action security_group_rules [ 620.440402] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 058c2139-5b77-4965-b2d8-ecc46af22480 with Priority: HIGHEST for action security_group_members [ 620.440531] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 085cd66a-0a2c-4190-bd53-796d0d09ca76 with Priority: HIGHEST for action port [ 620.441314] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-058c2139-5b77-4965-b2d8-ecc46af22480 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.441314] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-058c2139-5b77-4965-b2d8-ecc46af22480" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.441314] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-058c2139-5b77-4965-b2d8-ecc46af22480" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.441314] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-058c2139-5b77-4965-b2d8-ecc46af22480" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.441681] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('058c2139-5b77-4965-b2d8-ecc46af22480',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.443761] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-058c2139-5b77-4965-b2d8-ecc46af22480 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.443761] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-058c2139-5b77-4965-b2d8-ecc46af22480" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.443761] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-058c2139-5b77-4965-b2d8-ecc46af22480" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.443761] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-058c2139-5b77-4965-b2d8-ecc46af22480" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.443761] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.443761] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.443761] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.443761] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.443761] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.443761] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('058c2139-5b77-4965-b2d8-ecc46af22480',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.444870] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-085cd66a-0a2c-4190-bd53-796d0d09ca76 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.444870] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-085cd66a-0a2c-4190-bd53-796d0d09ca76" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.444870] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-085cd66a-0a2c-4190-bd53-796d0d09ca76" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.445033] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-085cd66a-0a2c-4190-bd53-796d0d09ca76" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.445069] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('085cd66a-0a2c-4190-bd53-796d0d09ca76',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.946789] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-058c2139-5b77-4965-b2d8-ecc46af22480 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.946789] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-058c2139-5b77-4965-b2d8-ecc46af22480" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.947367] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('058c2139-5b77-4965-b2d8-ecc46af22480',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.948211] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 085cd66a-0a2c-4190-bd53-796d0d09ca76 with status ACTIVE [ 620.948543] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.948680] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.948763] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.949688] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.949688] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.949688] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.949688] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.949688] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.950019] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.950019] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.950098] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.950309] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.950347] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.950877] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.950877] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.950877] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 085cd66a-0a2c-4190-bd53-796d0d09ca76 is going to be updated. [ 620.978716] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.978962] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.978962] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.979145] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.979276] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.979431] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-085cd66a-0a2c-4190-bd53-796d0d09ca76" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.068185] env[65337]: INFO networking_nsxv3.common.synchronization [req-ca282f5c-8f40-427a-8743-952947d327c8 req-29d7d394-a64a-4d55-b1dd-8d2be5e599e1 tempest-ServerDiagnosticsTest-117228076 tempest-ServerDiagnosticsTest-117228076-project-member] Enqueued Resource ID: 9282454d-037f-4e64-902c-636a49b89434 with Priority: HIGHEST for action security_group_members [ 621.068185] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9282454d-037f-4e64-902c-636a49b89434 with Priority: HIGHEST for action security_group_members [ 621.068185] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-9282454d-037f-4e64-902c-636a49b89434 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.068185] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9282454d-037f-4e64-902c-636a49b89434" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.068185] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9282454d-037f-4e64-902c-636a49b89434" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.068185] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9282454d-037f-4e64-902c-636a49b89434" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.068618] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.068920] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.069406] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.069665] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.069841] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.070028] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9282454d-037f-4e64-902c-636a49b89434',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.418775] env[65337]: INFO networking_nsxv3.common.synchronization [req-fd7dc3cf-603c-4330-858b-920b4fd9482e req-25468ef7-4efa-4aa2-b1f9-fde516c09bc3 tempest-DeleteServersAdminTestJSON-2138140639 tempest-DeleteServersAdminTestJSON-2138140639-project-admin] Enqueued Resource ID: a4c4fbaa-f4c9-4326-babb-bda6619acdf6 with Priority: HIGHEST for action security_group_members [ 621.418775] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4c4fbaa-f4c9-4326-babb-bda6619acdf6 with Priority: HIGHEST for action security_group_members [ 621.418775] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4c4fbaa-f4c9-4326-babb-bda6619acdf6 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.418775] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4c4fbaa-f4c9-4326-babb-bda6619acdf6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.418775] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4c4fbaa-f4c9-4326-babb-bda6619acdf6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.419464] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4c4fbaa-f4c9-4326-babb-bda6619acdf6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.419919] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.420201] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.420376] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.420632] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.420804] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.421196] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a4c4fbaa-f4c9-4326-babb-bda6619acdf6',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.454461] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('058c2139-5b77-4965-b2d8-ecc46af22480',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.504069] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock network-292 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.504963] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "network-292" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.505087] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "network-292" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.505492] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "network-292" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.506304] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.506304] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.506304] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.506304] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.506869] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.507058] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 621.507194] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 621.507353] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 621.507523] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 621.507703] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 621.507867] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 621.508261] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 621.528273] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 621.528455] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 621.528584] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 621.528746] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "network-292" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.529084] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock port-c4c552e9-19a8-46da-9082-40574ea898af taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.529678] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "port-c4c552e9-19a8-46da-9082-40574ea898af" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.529678] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "port-c4c552e9-19a8-46da-9082-40574ea898af" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.529813] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "port-c4c552e9-19a8-46da-9082-40574ea898af" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.529848] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c4c552e9-19a8-46da-9082-40574ea898af',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.573586] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.573824] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.574013] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.574200] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.574316] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.574545] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.575241] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.575241] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.575241] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.575241] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.575241] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9282454d-037f-4e64-902c-636a49b89434 already deleted. [ 621.575241] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9282454d-037f-4e64-902c-636a49b89434" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.924757] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.924757] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.924757] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.925189] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.925189] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.925189] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.925189] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.925189] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.927261] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.927261] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.927261] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4c4fbaa-f4c9-4326-babb-bda6619acdf6 is going to be updated. [ 621.942069] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5afc8a2a-3bb1-4c3e-a10b-0941514929b4 in Status: SUCCESS [ 621.942069] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5afc8a2a-3bb1-4c3e-a10b-0941514929b4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.957553] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.957966] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.957966] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.958078] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.958123] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.958220] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 058c2139-5b77-4965-b2d8-ecc46af22480 is going to be created. [ 621.973720] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.973720] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.973720] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.973720] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.973720] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.984085] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4c4fbaa-f4c9-4326-babb-bda6619acdf6 in Status: IN_PROGRESS for 2s [ 621.986728] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.986882] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.986931] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.987531] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.987531] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.997268] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 058c2139-5b77-4965-b2d8-ecc46af22480 in Status: UNINITIALIZED for 2s [ 622.037055] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.037055] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.037055] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.037055] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.037055] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.037055] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Segment Port c4c552e9-19a8-46da-9082-40574ea898af not found, creating... [ 622.037055] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.037055] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.037055] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.037055] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.037055] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.037647] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.037647] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.037647] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.038362] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.038685] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.040076] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Resource: SegmentPort with ID: c4c552e9-19a8-46da-9082-40574ea898af is going to be created. [ 622.063108] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.063108] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.063108] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.063108] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.063108] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.063108] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "port-c4c552e9-19a8-46da-9082-40574ea898af" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.859549] env[65337]: INFO networking_nsxv3.common.synchronization [req-ad75d86e-0f4d-4923-843f-07ee5774f5ba req-bfb6ff84-ef5b-4670-aa4d-35212e1b7d4e tempest-SecurityGroupRulesTestJSON-1213382043 tempest-SecurityGroupRulesTestJSON-1213382043-project-member] Enqueued Resource ID: 1724b9fe-bdfa-4fee-b39e-f90f1007f704 with Priority: HIGHEST for action security_group_rules [ 622.860184] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1724b9fe-bdfa-4fee-b39e-f90f1007f704 with Priority: HIGHEST for action security_group_rules [ 622.860510] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1724b9fe-bdfa-4fee-b39e-f90f1007f704 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.861591] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1724b9fe-bdfa-4fee-b39e-f90f1007f704" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.861591] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1724b9fe-bdfa-4fee-b39e-f90f1007f704" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.861907] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1724b9fe-bdfa-4fee-b39e-f90f1007f704" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.861907] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1724b9fe-bdfa-4fee-b39e-f90f1007f704',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.897473] env[65337]: INFO networking_nsxv3.common.synchronization [req-ca282f5c-8f40-427a-8743-952947d327c8 req-7e8ac5a8-133a-4d21-a242-1497064ac923 service nova] Enqueued Resource ID: 9282454d-037f-4e64-902c-636a49b89434 with Priority: HIGHEST for action security_group_rules [ 622.897858] env[65337]: INFO networking_nsxv3.common.synchronization [req-ca282f5c-8f40-427a-8743-952947d327c8 req-7e8ac5a8-133a-4d21-a242-1497064ac923 service nova] Enqueued Resource ID: 9282454d-037f-4e64-902c-636a49b89434 with Priority: HIGHEST for action security_group_members [ 622.898017] env[65337]: INFO networking_nsxv3.common.synchronization [req-ca282f5c-8f40-427a-8743-952947d327c8 req-7e8ac5a8-133a-4d21-a242-1497064ac923 service nova] Enqueued Resource ID: c4c552e9-19a8-46da-9082-40574ea898af with Priority: HIGHEST for action port [ 622.898966] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9282454d-037f-4e64-902c-636a49b89434 with Priority: HIGHEST for action security_group_rules [ 622.899109] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9282454d-037f-4e64-902c-636a49b89434 with Priority: HIGHEST for action security_group_members [ 622.900078] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4c552e9-19a8-46da-9082-40574ea898af with Priority: HIGHEST for action port [ 622.900078] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9282454d-037f-4e64-902c-636a49b89434 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.900078] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9282454d-037f-4e64-902c-636a49b89434" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.900078] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9282454d-037f-4e64-902c-636a49b89434" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.900436] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9282454d-037f-4e64-902c-636a49b89434" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.900436] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9282454d-037f-4e64-902c-636a49b89434',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.904019] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-9282454d-037f-4e64-902c-636a49b89434 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.904019] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9282454d-037f-4e64-902c-636a49b89434" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.904019] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9282454d-037f-4e64-902c-636a49b89434" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.904019] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9282454d-037f-4e64-902c-636a49b89434" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.904019] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.904019] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.904019] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.904019] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.904019] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.904019] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9282454d-037f-4e64-902c-636a49b89434',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.904019] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-c4c552e9-19a8-46da-9082-40574ea898af taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.904019] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c4c552e9-19a8-46da-9082-40574ea898af" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.904019] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c4c552e9-19a8-46da-9082-40574ea898af" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.904019] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c4c552e9-19a8-46da-9082-40574ea898af" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.904019] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c4c552e9-19a8-46da-9082-40574ea898af',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.309166] env[65337]: INFO networking_nsxv3.common.synchronization [req-90bc8eda-974d-45e5-ae84-68714e32534c req-8d003c6a-827e-4355-9aac-2d3b8f6cf3ba tempest-ListImageFiltersTestJSON-525832378 tempest-ListImageFiltersTestJSON-525832378-project-member] Enqueued Resource ID: 2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24 with Priority: HIGHEST for action security_group_members [ 623.309769] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24 with Priority: HIGHEST for action security_group_members [ 623.310089] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.310219] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.310283] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.310527] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.310681] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.310786] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.310828] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.310978] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.311077] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.311240] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.391036] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.391194] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.391360] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.391672] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.391772] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.391886] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1724b9fe-bdfa-4fee-b39e-f90f1007f704 already deleted. [ 623.391985] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1724b9fe-bdfa-4fee-b39e-f90f1007f704" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.405621] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-9282454d-037f-4e64-902c-636a49b89434 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.405751] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9282454d-037f-4e64-902c-636a49b89434" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.408204] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9282454d-037f-4e64-902c-636a49b89434',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.409798] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c4c552e9-19a8-46da-9082-40574ea898af with status ACTIVE [ 623.410598] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.410598] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.410761] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.411072] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.411146] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.411340] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.411448] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.411570] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.412021] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.412021] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.412021] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.412320] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.412425] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.412562] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.412836] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.412836] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c4c552e9-19a8-46da-9082-40574ea898af is going to be updated. [ 623.434978] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.434978] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.434978] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.436369] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.436369] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.436369] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c4c552e9-19a8-46da-9082-40574ea898af" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.727149] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock network-292 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.727149] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "network-292" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.727149] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "network-292" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.727149] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "network-292" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.727149] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.727149] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.727149] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.727149] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.727149] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.728485] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 623.729274] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 623.730735] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 623.730735] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 623.730735] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 623.730735] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 623.730735] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 623.751940] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 623.752143] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 623.752278] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 623.752446] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "network-292" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.752759] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock port-e66e75dc-da82-4139-a981-370b041e6731 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.752923] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "port-e66e75dc-da82-4139-a981-370b041e6731" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.753101] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "port-e66e75dc-da82-4139-a981-370b041e6731" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.753437] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "port-e66e75dc-da82-4139-a981-370b041e6731" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.753586] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e66e75dc-da82-4139-a981-370b041e6731',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.813431] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.813720] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.813893] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.814035] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.814145] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.814381] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.814517] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.814591] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.815054] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.815054] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.815054] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24 already deleted. [ 623.815207] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.916226] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9282454d-037f-4e64-902c-636a49b89434',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.995675] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4c4fbaa-f4c9-4326-babb-bda6619acdf6 in Status: SUCCESS [ 623.995675] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4c4fbaa-f4c9-4326-babb-bda6619acdf6 deletion is rescheduled due to dependency. [ 623.995675] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4c4fbaa-f4c9-4326-babb-bda6619acdf6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.006070] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 058c2139-5b77-4965-b2d8-ecc46af22480 in Status: SUCCESS [ 624.006288] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-058c2139-5b77-4965-b2d8-ecc46af22480" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.006444] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-058c2139-5b77-4965-b2d8-ecc46af22480" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.006655] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-058c2139-5b77-4965-b2d8-ecc46af22480" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.006850] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.006964] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.007037] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.007189] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.007270] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.007363] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-058c2139-5b77-4965-b2d8-ecc46af22480" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.007455] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('058c2139-5b77-4965-b2d8-ecc46af22480',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.256626] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.256921] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.257147] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.257501] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.257666] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.257843] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Segment Port e66e75dc-da82-4139-a981-370b041e6731 not found, creating... [ 624.258222] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.258911] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.259263] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.259582] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.259767] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.260145] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.260334] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.260449] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.260663] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.260837] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.261063] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Resource: SegmentPort with ID: e66e75dc-da82-4139-a981-370b041e6731 is going to be created. [ 624.287406] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.287494] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.287587] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.288148] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.288148] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.288356] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "port-e66e75dc-da82-4139-a981-370b041e6731" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.419177] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.419511] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.419511] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.419653] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.420154] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.420154] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9282454d-037f-4e64-902c-636a49b89434 is going to be created. [ 624.449353] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.449577] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.449649] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.449886] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.450085] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.465548] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9282454d-037f-4e64-902c-636a49b89434 in Status: UNINITIALIZED for 2s [ 624.510191] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-058c2139-5b77-4965-b2d8-ecc46af22480 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.510685] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-058c2139-5b77-4965-b2d8-ecc46af22480" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.510685] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-058c2139-5b77-4965-b2d8-ecc46af22480" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.510685] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-058c2139-5b77-4965-b2d8-ecc46af22480" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.510938] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.510938] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.513033] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.513033] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.513033] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.513033] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-058c2139-5b77-4965-b2d8-ecc46af22480" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.513033] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-058c2139-5b77-4965-b2d8-ecc46af22480 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.513033] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-058c2139-5b77-4965-b2d8-ecc46af22480" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.513033] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-058c2139-5b77-4965-b2d8-ecc46af22480" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.513033] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-058c2139-5b77-4965-b2d8-ecc46af22480" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.513033] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.513033] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.513033] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.513033] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.513033] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.513033] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-058c2139-5b77-4965-b2d8-ecc46af22480" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.513033] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('058c2139-5b77-4965-b2d8-ecc46af22480',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.007945] env[65337]: INFO networking_nsxv3.common.synchronization [req-90bc8eda-974d-45e5-ae84-68714e32534c req-5a18a048-cc7b-4dd1-a761-8706270304cd service nova] Enqueued Resource ID: 2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24 with Priority: HIGHEST for action security_group_rules [ 625.007945] env[65337]: INFO networking_nsxv3.common.synchronization [req-90bc8eda-974d-45e5-ae84-68714e32534c req-5a18a048-cc7b-4dd1-a761-8706270304cd service nova] Enqueued Resource ID: 2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24 with Priority: HIGHEST for action security_group_members [ 625.007945] env[65337]: INFO networking_nsxv3.common.synchronization [req-90bc8eda-974d-45e5-ae84-68714e32534c req-5a18a048-cc7b-4dd1-a761-8706270304cd service nova] Enqueued Resource ID: e66e75dc-da82-4139-a981-370b041e6731 with Priority: HIGHEST for action port [ 625.007945] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24 with Priority: HIGHEST for action security_group_rules [ 625.007945] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24 with Priority: HIGHEST for action security_group_members [ 625.007945] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e66e75dc-da82-4139-a981-370b041e6731 with Priority: HIGHEST for action port [ 625.007945] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.009057] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.009057] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.009057] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.009057] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.010043] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.010043] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.010043] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.010043] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.010043] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.010491] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.010491] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.010491] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.010491] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.010611] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.012652] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-e66e75dc-da82-4139-a981-370b041e6731 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.012652] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e66e75dc-da82-4139-a981-370b041e6731" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.012652] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e66e75dc-da82-4139-a981-370b041e6731" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.012652] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e66e75dc-da82-4139-a981-370b041e6731" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.012652] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e66e75dc-da82-4139-a981-370b041e6731',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.018013] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 058c2139-5b77-4965-b2d8-ecc46af22480: rpc.has_security_group_logging(os_id): False [ 625.035457] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.035669] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.035812] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.036151] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.036327] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.036636] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.036794] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.036897] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.037145] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.037277] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.037695] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.037860] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.037961] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.038184] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.038337] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.038912] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.038912] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.038912] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.039144] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.039262] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.039506] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 058c2139-5b77-4965-b2d8-ecc46af22480 is going to be created. [ 625.108304] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.108304] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.108304] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.108494] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.108805] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.121993] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 058c2139-5b77-4965-b2d8-ecc46af22480 in Status: IN_PROGRESS for 2s [ 625.515740] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.515740] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.516334] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.517343] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e66e75dc-da82-4139-a981-370b041e6731 with status ACTIVE [ 625.517849] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.518011] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.518196] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.518561] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.518824] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.519331] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.519331] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.519331] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.519593] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.519683] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.520970] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.520970] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.520970] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.520970] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.520970] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.520970] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e66e75dc-da82-4139-a981-370b041e6731 is going to be updated. [ 625.557064] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.557271] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.557271] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.557485] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.557619] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.557789] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e66e75dc-da82-4139-a981-370b041e6731" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.634675] env[65337]: INFO networking_nsxv3.common.synchronization [req-112db399-2fac-47d5-abb1-7e6a58a83eee req-61ee6b54-b9d0-4013-9fdf-de1ca3ed2815 tempest-InstanceActionsTestJSON-1203928558 tempest-InstanceActionsTestJSON-1203928558-project-member] Enqueued Resource ID: aacfa5f1-5795-4724-a0b1-919591e92f80 with Priority: HIGHEST for action security_group_members [ 625.635489] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aacfa5f1-5795-4724-a0b1-919591e92f80 with Priority: HIGHEST for action security_group_members [ 625.635908] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-aacfa5f1-5795-4724-a0b1-919591e92f80 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.636069] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aacfa5f1-5795-4724-a0b1-919591e92f80" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.636152] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aacfa5f1-5795-4724-a0b1-919591e92f80" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.636473] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aacfa5f1-5795-4724-a0b1-919591e92f80" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.636787] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.636935] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.637030] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.637249] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.641767] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.641767] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aacfa5f1-5795-4724-a0b1-919591e92f80',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.002064] env[65337]: INFO networking_nsxv3.common.synchronization [req-003c134e-9fb2-4ef8-b36c-2f5bda9a50c5 req-6a1a0881-6817-4bd1-a533-1c7cafb62d18 tempest-TenantUsagesTestJSON-1174146655 tempest-TenantUsagesTestJSON-1174146655-project-member] Enqueued Resource ID: 114a6017-3f79-438c-9593-053232b9f176 with Priority: HIGHEST for action security_group_members [ 626.002901] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 114a6017-3f79-438c-9593-053232b9f176 with Priority: HIGHEST for action security_group_members [ 626.003375] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-114a6017-3f79-438c-9593-053232b9f176 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.003573] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-114a6017-3f79-438c-9593-053232b9f176" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.003651] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-114a6017-3f79-438c-9593-053232b9f176" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.003922] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-114a6017-3f79-438c-9593-053232b9f176" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.004176] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.004314] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.004396] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.004643] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.004773] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.004898] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('114a6017-3f79-438c-9593-053232b9f176',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.023426] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.145338] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.145532] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.145578] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.145824] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.145933] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.146148] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.146273] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.146359] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.146484] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.146566] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.146648] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aacfa5f1-5795-4724-a0b1-919591e92f80 already deleted. [ 626.146725] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aacfa5f1-5795-4724-a0b1-919591e92f80" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.211427] env[65337]: INFO networking_nsxv3.common.synchronization [None req-8417ce19-a926-40f5-8304-ea52762cbdb0 None None] Enqueued Resource ID: db3b5436-1bf8-4759-ab1c-d382944ee748 with Priority: HIGHEST for action port [ 626.212086] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db3b5436-1bf8-4759-ab1c-d382944ee748 with Priority: HIGHEST for action port [ 626.212522] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-db3b5436-1bf8-4759-ab1c-d382944ee748 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.212522] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-db3b5436-1bf8-4759-ab1c-d382944ee748" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.212683] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-db3b5436-1bf8-4759-ab1c-d382944ee748" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.212853] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-db3b5436-1bf8-4759-ab1c-d382944ee748" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.212933] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('db3b5436-1bf8-4759-ab1c-d382944ee748',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.379535] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock network-818 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.380175] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "network-818" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.380483] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "network-818" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.380914] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "network-818" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.381319] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.381597] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.381803] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.382172] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.382419] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.382741] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 626.382942] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 626.383171] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 626.383372] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 626.384696] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 626.384696] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 626.384696] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 626.404859] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 626.405165] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 626.405401] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 626.405680] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "network-818" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.406177] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock port-e78eb6c1-8af0-4434-9b2d-2a888e8e5720 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.406462] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "port-e78eb6c1-8af0-4434-9b2d-2a888e8e5720" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.406665] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "port-e78eb6c1-8af0-4434-9b2d-2a888e8e5720" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.407144] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "port-e78eb6c1-8af0-4434-9b2d-2a888e8e5720" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.407380] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e78eb6c1-8af0-4434-9b2d-2a888e8e5720',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.475365] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9282454d-037f-4e64-902c-636a49b89434 in Status: SUCCESS [ 626.475640] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9282454d-037f-4e64-902c-636a49b89434" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.476961] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9282454d-037f-4e64-902c-636a49b89434" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.476961] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9282454d-037f-4e64-902c-636a49b89434" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.476961] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.476961] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.476961] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.476961] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.476961] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.476961] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9282454d-037f-4e64-902c-636a49b89434" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.476961] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9282454d-037f-4e64-902c-636a49b89434',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.507801] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.507964] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.508071] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.508252] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.508345] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.508529] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.508675] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.508675] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.508829] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.508906] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.508992] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 114a6017-3f79-438c-9593-053232b9f176 is going to be updated. [ 626.526509] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.526880] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.526880] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.526984] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.527082] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.527194] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24 is going to be created. [ 626.544485] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.544670] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.544715] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.545105] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.545105] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.553968] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.554182] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.554182] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.554396] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.554634] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.562476] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 114a6017-3f79-438c-9593-053232b9f176 in Status: IN_PROGRESS for 2s [ 626.563348] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24 in Status: UNINITIALIZED for 2s [ 626.715488] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port db3b5436-1bf8-4759-ab1c-d382944ee748 [ 626.715818] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.715996] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.716080] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.716300] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.716426] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.716526] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:db3b5436-1bf8-4759-ab1c-d382944ee748 already deleted. [ 626.716666] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-db3b5436-1bf8-4759-ab1c-d382944ee748" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.913144] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.913144] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.913144] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.913144] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.913144] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.913144] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Segment Port e78eb6c1-8af0-4434-9b2d-2a888e8e5720 not found, creating... [ 626.913144] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.913144] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.913144] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.913144] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.913144] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.913717] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.913717] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.913717] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.913717] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.913717] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.915525] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Resource: SegmentPort with ID: e78eb6c1-8af0-4434-9b2d-2a888e8e5720 is going to be created. [ 626.935035] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.935637] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.935637] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.935776] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.937512] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.937512] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "port-e78eb6c1-8af0-4434-9b2d-2a888e8e5720" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.981409] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-9282454d-037f-4e64-902c-636a49b89434 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.981409] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9282454d-037f-4e64-902c-636a49b89434" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.981409] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9282454d-037f-4e64-902c-636a49b89434" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.981409] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9282454d-037f-4e64-902c-636a49b89434" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.981409] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.981409] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.981409] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.981409] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.981409] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.981409] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9282454d-037f-4e64-902c-636a49b89434" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.981409] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-9282454d-037f-4e64-902c-636a49b89434 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.982068] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9282454d-037f-4e64-902c-636a49b89434" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.982068] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9282454d-037f-4e64-902c-636a49b89434" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.982068] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9282454d-037f-4e64-902c-636a49b89434" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.982068] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.982068] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.982068] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.982245] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.982245] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.983046] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9282454d-037f-4e64-902c-636a49b89434" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.983046] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9282454d-037f-4e64-902c-636a49b89434',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.139052] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 058c2139-5b77-4965-b2d8-ecc46af22480 in Status: SUCCESS [ 627.139052] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-058c2139-5b77-4965-b2d8-ecc46af22480" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.486610] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9282454d-037f-4e64-902c-636a49b89434: rpc.has_security_group_logging(os_id): False [ 627.508378] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.508541] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.508628] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.509424] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.509489] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.509713] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.509829] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.509915] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.510067] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.510153] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.510343] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.510509] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.510776] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.510907] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.511019] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.511479] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.511479] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.511479] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.511657] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.511657] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.511657] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9282454d-037f-4e64-902c-636a49b89434 is going to be created. [ 627.584698] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.584698] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.585023] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.585023] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.585848] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.595834] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9282454d-037f-4e64-902c-636a49b89434 in Status: IN_PROGRESS for 2s [ 627.729210] env[65337]: INFO networking_nsxv3.common.synchronization [req-112db399-2fac-47d5-abb1-7e6a58a83eee req-524f6094-06cc-4dfb-8b47-2a5ff36eee66 service nova] Enqueued Resource ID: aacfa5f1-5795-4724-a0b1-919591e92f80 with Priority: HIGHEST for action security_group_rules [ 627.729210] env[65337]: INFO networking_nsxv3.common.synchronization [req-112db399-2fac-47d5-abb1-7e6a58a83eee req-524f6094-06cc-4dfb-8b47-2a5ff36eee66 service nova] Enqueued Resource ID: aacfa5f1-5795-4724-a0b1-919591e92f80 with Priority: HIGHEST for action security_group_members [ 627.730818] env[65337]: INFO networking_nsxv3.common.synchronization [req-112db399-2fac-47d5-abb1-7e6a58a83eee req-524f6094-06cc-4dfb-8b47-2a5ff36eee66 service nova] Enqueued Resource ID: e78eb6c1-8af0-4434-9b2d-2a888e8e5720 with Priority: HIGHEST for action port [ 627.732351] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aacfa5f1-5795-4724-a0b1-919591e92f80 with Priority: HIGHEST for action security_group_rules [ 627.732525] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aacfa5f1-5795-4724-a0b1-919591e92f80 with Priority: HIGHEST for action security_group_members [ 627.732652] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e78eb6c1-8af0-4434-9b2d-2a888e8e5720 with Priority: HIGHEST for action port [ 627.733642] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aacfa5f1-5795-4724-a0b1-919591e92f80 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.734448] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aacfa5f1-5795-4724-a0b1-919591e92f80" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.734448] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aacfa5f1-5795-4724-a0b1-919591e92f80" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.734448] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aacfa5f1-5795-4724-a0b1-919591e92f80" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.734670] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aacfa5f1-5795-4724-a0b1-919591e92f80',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.737133] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-aacfa5f1-5795-4724-a0b1-919591e92f80 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.737133] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aacfa5f1-5795-4724-a0b1-919591e92f80" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.737133] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aacfa5f1-5795-4724-a0b1-919591e92f80" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.737133] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aacfa5f1-5795-4724-a0b1-919591e92f80" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.737133] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.737133] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.737133] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.737133] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.739422] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.739422] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aacfa5f1-5795-4724-a0b1-919591e92f80',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.739422] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-e78eb6c1-8af0-4434-9b2d-2a888e8e5720 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.739635] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e78eb6c1-8af0-4434-9b2d-2a888e8e5720" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.739635] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e78eb6c1-8af0-4434-9b2d-2a888e8e5720" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.739741] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e78eb6c1-8af0-4434-9b2d-2a888e8e5720" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.739778] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e78eb6c1-8af0-4434-9b2d-2a888e8e5720',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.242060] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aacfa5f1-5795-4724-a0b1-919591e92f80',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.244039] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-aacfa5f1-5795-4724-a0b1-919591e92f80 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.244039] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aacfa5f1-5795-4724-a0b1-919591e92f80" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.244240] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e78eb6c1-8af0-4434-9b2d-2a888e8e5720 with status ACTIVE [ 628.245112] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.245112] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.245112] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.245112] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.245112] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.245112] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.246688] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.246918] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.247047] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.247143] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.247345] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.247451] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.247508] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.247661] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.248103] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.248178] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e78eb6c1-8af0-4434-9b2d-2a888e8e5720 is going to be updated. [ 628.274893] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.274893] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.274893] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.274893] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.274893] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.274893] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e78eb6c1-8af0-4434-9b2d-2a888e8e5720" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.577254] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24 in Status: SUCCESS [ 628.577510] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.577789] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.578217] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.578485] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.578591] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.578774] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.579768] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.579768] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.579768] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.579768] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.581307] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 114a6017-3f79-438c-9593-053232b9f176 in Status: SUCCESS [ 628.581476] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 114a6017-3f79-438c-9593-053232b9f176 deletion is rescheduled due to dependency. [ 628.581678] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-114a6017-3f79-438c-9593-053232b9f176" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.751726] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aacfa5f1-5795-4724-a0b1-919591e92f80',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.777612] env[65337]: INFO networking_nsxv3.common.synchronization [None req-537ad5be-be98-4408-8d9a-ec50759a3ef2 None None] Enqueued Resource ID: c94fa34b-0d85-48f6-9c96-36e2225b74d9 with Priority: HIGHEST for action port [ 628.778999] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c94fa34b-0d85-48f6-9c96-36e2225b74d9 with Priority: HIGHEST for action port [ 628.779398] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-c94fa34b-0d85-48f6-9c96-36e2225b74d9 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.779569] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c94fa34b-0d85-48f6-9c96-36e2225b74d9" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.779819] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c94fa34b-0d85-48f6-9c96-36e2225b74d9" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.779924] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c94fa34b-0d85-48f6-9c96-36e2225b74d9" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.780312] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c94fa34b-0d85-48f6-9c96-36e2225b74d9',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.084252] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.084406] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.084481] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.084709] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.084905] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.085433] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.085433] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.085433] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.085566] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.085612] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.087201] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.087201] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.087201] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.087201] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.087201] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.087201] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.087201] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.087201] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.087201] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.087201] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.087201] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.258506] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.258773] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.258903] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.259195] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.259299] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.260030] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aacfa5f1-5795-4724-a0b1-919591e92f80 is going to be created. [ 629.282988] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c94fa34b-0d85-48f6-9c96-36e2225b74d9 [ 629.282988] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.282988] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.283650] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.283650] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.283845] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.284053] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c94fa34b-0d85-48f6-9c96-36e2225b74d9 already deleted. [ 629.284139] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c94fa34b-0d85-48f6-9c96-36e2225b74d9" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.292144] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.292393] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.292393] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.293038] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.293038] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.307437] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aacfa5f1-5795-4724-a0b1-919591e92f80 in Status: UNINITIALIZED for 2s [ 629.593565] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24: rpc.has_security_group_logging(os_id): False [ 629.614451] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9282454d-037f-4e64-902c-636a49b89434 in Status: SUCCESS [ 629.614775] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9282454d-037f-4e64-902c-636a49b89434" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.616032] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.616280] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.616377] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.616655] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.616842] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.618122] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.618122] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.618122] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.618122] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.618553] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.618894] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.619274] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.619393] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.620459] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.620459] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.620631] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.620948] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.621137] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.621403] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.621638] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.621869] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24 is going to be created. [ 629.696079] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.696211] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.696291] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.696519] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.696722] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.712482] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24 in Status: IN_PROGRESS for 2s [ 630.177550] env[65337]: INFO networking_nsxv3.common.synchronization [req-302d1498-d2af-4046-8086-1057ca8afc08 req-c11b1d52-605a-4c1f-a8f1-940291ab1b5a tempest-SecurityGroupRulesTestJSON-1213382043 tempest-SecurityGroupRulesTestJSON-1213382043-project-member] Enqueued Resource ID: c9a07d84-d8af-4314-98b5-26b97cb9935a with Priority: HIGHEST for action security_group_rules [ 630.179017] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9a07d84-d8af-4314-98b5-26b97cb9935a with Priority: HIGHEST for action security_group_rules [ 630.179017] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c9a07d84-d8af-4314-98b5-26b97cb9935a taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.179017] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c9a07d84-d8af-4314-98b5-26b97cb9935a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.179017] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c9a07d84-d8af-4314-98b5-26b97cb9935a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.179017] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c9a07d84-d8af-4314-98b5-26b97cb9935a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.179358] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c9a07d84-d8af-4314-98b5-26b97cb9935a',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.287730] env[65337]: INFO networking_nsxv3.common.synchronization [req-fc14f48e-0c54-442f-9d83-8997a8d4f9d1 req-940c499a-7ab0-42e7-83cc-cb9bd02fa3aa tempest-ServersNegativeTestJSON-62579270 tempest-ServersNegativeTestJSON-62579270-project-member] Enqueued Resource ID: b2e84376-5c9f-45e7-9949-59bf17a96c95 with Priority: HIGHEST for action security_group_members [ 630.288867] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2e84376-5c9f-45e7-9949-59bf17a96c95 with Priority: HIGHEST for action security_group_members [ 630.288867] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-b2e84376-5c9f-45e7-9949-59bf17a96c95 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.289050] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b2e84376-5c9f-45e7-9949-59bf17a96c95" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.289122] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b2e84376-5c9f-45e7-9949-59bf17a96c95" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.289664] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b2e84376-5c9f-45e7-9949-59bf17a96c95" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.289785] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.289925] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.289994] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.290586] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.290586] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.290586] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b2e84376-5c9f-45e7-9949-59bf17a96c95',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.704981] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.704981] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.704981] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.705279] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.705279] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.705279] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c9a07d84-d8af-4314-98b5-26b97cb9935a already deleted. [ 630.705384] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c9a07d84-d8af-4314-98b5-26b97cb9935a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.731062] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock network-395 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.731227] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "network-395" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.731338] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "network-395" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.731709] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "network-395" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.732258] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.732489] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.732563] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.732788] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.732865] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.733093] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 630.733169] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 630.733272] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 630.733388] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 630.733477] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 630.733585] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 630.733760] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 630.755404] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 630.755404] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 630.755404] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 630.755404] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "network-395" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.755404] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock port-c4403627-495f-4786-8561-4b2910ee5b56 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.755404] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "port-c4403627-495f-4786-8561-4b2910ee5b56" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.755778] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "port-c4403627-495f-4786-8561-4b2910ee5b56" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.755778] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "port-c4403627-495f-4786-8561-4b2910ee5b56" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.755987] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c4403627-495f-4786-8561-4b2910ee5b56',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.794318] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.794513] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.794627] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.794828] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.794923] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.795139] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.795263] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.795355] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.795551] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.795636] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.795721] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b2e84376-5c9f-45e7-9949-59bf17a96c95 already deleted. [ 630.795800] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b2e84376-5c9f-45e7-9949-59bf17a96c95" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.258996] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.264443] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.264443] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.264443] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.264443] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.264443] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Segment Port c4403627-495f-4786-8561-4b2910ee5b56 not found, creating... [ 631.264443] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.264443] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.265173] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.265173] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.265173] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.265337] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.266079] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.266079] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.266079] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.266079] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.266364] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Resource: SegmentPort with ID: c4403627-495f-4786-8561-4b2910ee5b56 is going to be created. [ 631.289735] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.289735] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.289735] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.290023] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.290247] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.290480] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "port-c4403627-495f-4786-8561-4b2910ee5b56" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.319417] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aacfa5f1-5795-4724-a0b1-919591e92f80 in Status: SUCCESS [ 631.320601] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aacfa5f1-5795-4724-a0b1-919591e92f80" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.320601] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aacfa5f1-5795-4724-a0b1-919591e92f80" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.320601] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aacfa5f1-5795-4724-a0b1-919591e92f80" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.320601] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.320601] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.320601] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.320601] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.320601] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.321031] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aacfa5f1-5795-4724-a0b1-919591e92f80" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.321031] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aacfa5f1-5795-4724-a0b1-919591e92f80',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.728126] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24 in Status: SUCCESS [ 631.728357] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.823977] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-aacfa5f1-5795-4724-a0b1-919591e92f80 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.824206] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aacfa5f1-5795-4724-a0b1-919591e92f80" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.824298] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aacfa5f1-5795-4724-a0b1-919591e92f80" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.824741] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aacfa5f1-5795-4724-a0b1-919591e92f80" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.824968] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.825146] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.825203] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.825435] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.825568] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.825729] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aacfa5f1-5795-4724-a0b1-919591e92f80" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.825992] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-aacfa5f1-5795-4724-a0b1-919591e92f80 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.826165] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aacfa5f1-5795-4724-a0b1-919591e92f80" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.826295] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aacfa5f1-5795-4724-a0b1-919591e92f80" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.826544] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aacfa5f1-5795-4724-a0b1-919591e92f80" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.826711] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.826771] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.827588] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.827588] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.827588] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.827588] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aacfa5f1-5795-4724-a0b1-919591e92f80" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.827588] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aacfa5f1-5795-4724-a0b1-919591e92f80',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.044815] env[65337]: INFO networking_nsxv3.common.synchronization [req-fc14f48e-0c54-442f-9d83-8997a8d4f9d1 req-82f21371-d997-4641-befd-71ee908d272d service nova] Enqueued Resource ID: b2e84376-5c9f-45e7-9949-59bf17a96c95 with Priority: HIGHEST for action security_group_rules [ 632.045143] env[65337]: INFO networking_nsxv3.common.synchronization [req-fc14f48e-0c54-442f-9d83-8997a8d4f9d1 req-82f21371-d997-4641-befd-71ee908d272d service nova] Enqueued Resource ID: b2e84376-5c9f-45e7-9949-59bf17a96c95 with Priority: HIGHEST for action security_group_members [ 632.045266] env[65337]: INFO networking_nsxv3.common.synchronization [req-fc14f48e-0c54-442f-9d83-8997a8d4f9d1 req-82f21371-d997-4641-befd-71ee908d272d service nova] Enqueued Resource ID: c4403627-495f-4786-8561-4b2910ee5b56 with Priority: HIGHEST for action port [ 632.046532] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2e84376-5c9f-45e7-9949-59bf17a96c95 with Priority: HIGHEST for action security_group_rules [ 632.046532] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2e84376-5c9f-45e7-9949-59bf17a96c95 with Priority: HIGHEST for action security_group_members [ 632.046532] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4403627-495f-4786-8561-4b2910ee5b56 with Priority: HIGHEST for action port [ 632.046858] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b2e84376-5c9f-45e7-9949-59bf17a96c95 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.046858] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b2e84376-5c9f-45e7-9949-59bf17a96c95" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.046978] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b2e84376-5c9f-45e7-9949-59bf17a96c95" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.047262] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b2e84376-5c9f-45e7-9949-59bf17a96c95" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.047408] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b2e84376-5c9f-45e7-9949-59bf17a96c95',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.048561] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-b2e84376-5c9f-45e7-9949-59bf17a96c95 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.048746] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b2e84376-5c9f-45e7-9949-59bf17a96c95" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.048858] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b2e84376-5c9f-45e7-9949-59bf17a96c95" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.049057] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b2e84376-5c9f-45e7-9949-59bf17a96c95" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.049277] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.049780] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.049780] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.049780] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.049780] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.050102] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b2e84376-5c9f-45e7-9949-59bf17a96c95',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.054171] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-c4403627-495f-4786-8561-4b2910ee5b56 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.054171] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c4403627-495f-4786-8561-4b2910ee5b56" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.054171] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c4403627-495f-4786-8561-4b2910ee5b56" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.054171] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c4403627-495f-4786-8561-4b2910ee5b56" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.054171] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c4403627-495f-4786-8561-4b2910ee5b56',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.330280] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aacfa5f1-5795-4724-a0b1-919591e92f80: rpc.has_security_group_logging(os_id): False [ 632.348533] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.348782] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.348782] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.348942] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.349061] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.349250] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.349359] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.349418] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.349560] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.349640] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.349818] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.349903] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.349958] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.350139] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.350208] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.350402] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.350536] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.350536] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.350691] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.350759] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.350825] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aacfa5f1-5795-4724-a0b1-919591e92f80 is going to be created. [ 632.412534] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.412686] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.412760] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.412960] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.413151] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.427257] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aacfa5f1-5795-4724-a0b1-919591e92f80 in Status: IN_PROGRESS for 2s [ 632.556682] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b2e84376-5c9f-45e7-9949-59bf17a96c95',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.556954] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-b2e84376-5c9f-45e7-9949-59bf17a96c95 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.557085] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b2e84376-5c9f-45e7-9949-59bf17a96c95" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.557265] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c4403627-495f-4786-8561-4b2910ee5b56 with status ACTIVE [ 632.557471] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.557551] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.557617] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.557826] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.557918] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.558114] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.558181] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.558245] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.558396] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.558474] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.558651] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.558744] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.558803] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.558943] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.559767] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.560529] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c4403627-495f-4786-8561-4b2910ee5b56 is going to be updated. [ 632.604580] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.604580] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.604580] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.604580] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.604580] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.604580] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c4403627-495f-4786-8561-4b2910ee5b56" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.062705] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b2e84376-5c9f-45e7-9949-59bf17a96c95',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.568796] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.569241] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.569241] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.569350] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.569420] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.569551] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b2e84376-5c9f-45e7-9949-59bf17a96c95 is going to be created. [ 633.609110] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.609390] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.609455] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.609723] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.609977] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.623442] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b2e84376-5c9f-45e7-9949-59bf17a96c95 in Status: UNINITIALIZED for 2s [ 633.906070] env[65337]: INFO networking_nsxv3.common.synchronization [req-22f48669-e9bc-488c-8c1a-d2273be2ed9a req-b139b87f-88f0-445a-a3c3-6eb03be22c36 tempest-ServersWithSpecificFlavorTestJSON-1708740375 tempest-ServersWithSpecificFlavorTestJSON-1708740375-project-member] Enqueued Resource ID: c26a679a-9c5d-4a72-b91b-bd7f21348ea0 with Priority: HIGHEST for action security_group_members [ 633.906809] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c26a679a-9c5d-4a72-b91b-bd7f21348ea0 with Priority: HIGHEST for action security_group_members [ 633.907823] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-c26a679a-9c5d-4a72-b91b-bd7f21348ea0 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.907973] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c26a679a-9c5d-4a72-b91b-bd7f21348ea0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.908054] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c26a679a-9c5d-4a72-b91b-bd7f21348ea0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.908395] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c26a679a-9c5d-4a72-b91b-bd7f21348ea0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.909988] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.909988] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.909988] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.910364] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.912025] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.912025] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c26a679a-9c5d-4a72-b91b-bd7f21348ea0',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.099607] env[65337]: INFO networking_nsxv3.common.synchronization [None req-fbdb941f-4011-4f36-be2b-74d104584367 None None] Enqueued Resource ID: 7f31c712-6618-47d6-89e9-42be14689bc5 with Priority: HIGHEST for action port [ 634.100321] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f31c712-6618-47d6-89e9-42be14689bc5 with Priority: HIGHEST for action port [ 634.102526] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-7f31c712-6618-47d6-89e9-42be14689bc5 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.102672] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7f31c712-6618-47d6-89e9-42be14689bc5" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.102990] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7f31c712-6618-47d6-89e9-42be14689bc5" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.106600] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7f31c712-6618-47d6-89e9-42be14689bc5" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.106600] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7f31c712-6618-47d6-89e9-42be14689bc5',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.414644] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.414644] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.414644] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.415527] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.415527] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.415527] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.415527] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.415527] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.415825] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.415895] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.416018] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c26a679a-9c5d-4a72-b91b-bd7f21348ea0 already deleted. [ 634.416086] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c26a679a-9c5d-4a72-b91b-bd7f21348ea0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.446442] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aacfa5f1-5795-4724-a0b1-919591e92f80 in Status: SUCCESS [ 634.446687] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aacfa5f1-5795-4724-a0b1-919591e92f80" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.581393] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock network-976 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.581393] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "network-976" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.581393] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "network-976" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.582288] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "network-976" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.582288] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.582288] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.582439] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.583451] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.583451] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.583451] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 634.583451] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 634.583451] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 634.583451] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 634.583451] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 634.584079] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 634.584079] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 634.606070] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 634.606287] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 634.606386] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 634.606652] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "network-976" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.606895] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock port-e3036b3e-3979-4a9e-818c-8fa790d442c4 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.607078] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "port-e3036b3e-3979-4a9e-818c-8fa790d442c4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.607264] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "port-e3036b3e-3979-4a9e-818c-8fa790d442c4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.607600] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "port-e3036b3e-3979-4a9e-818c-8fa790d442c4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.607739] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e3036b3e-3979-4a9e-818c-8fa790d442c4',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.609369] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7f31c712-6618-47d6-89e9-42be14689bc5 [ 634.609369] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.609369] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.609369] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.609369] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.610023] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.610023] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7f31c712-6618-47d6-89e9-42be14689bc5 already deleted. [ 634.610023] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7f31c712-6618-47d6-89e9-42be14689bc5" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.116112] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.116112] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.116112] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.116112] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.116112] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.116112] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Segment Port e3036b3e-3979-4a9e-818c-8fa790d442c4 not found, creating... [ 635.117152] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.117342] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.117458] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.117714] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.118092] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.118177] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.120499] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.120499] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.120499] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.120499] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.120971] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Resource: SegmentPort with ID: e3036b3e-3979-4a9e-818c-8fa790d442c4 is going to be created. [ 635.151420] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.151420] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.151420] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.151420] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.151867] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.151867] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "port-e3036b3e-3979-4a9e-818c-8fa790d442c4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.638748] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b2e84376-5c9f-45e7-9949-59bf17a96c95 in Status: SUCCESS [ 635.639945] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b2e84376-5c9f-45e7-9949-59bf17a96c95" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.639945] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b2e84376-5c9f-45e7-9949-59bf17a96c95" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.639945] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b2e84376-5c9f-45e7-9949-59bf17a96c95" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.639945] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.642715] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.642715] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.642715] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.642715] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.642715] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b2e84376-5c9f-45e7-9949-59bf17a96c95" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.642715] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b2e84376-5c9f-45e7-9949-59bf17a96c95',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.938623] env[65337]: INFO networking_nsxv3.common.synchronization [req-22f48669-e9bc-488c-8c1a-d2273be2ed9a req-ca623377-b406-47b5-9c96-6e771d7cee77 service nova] Enqueued Resource ID: c26a679a-9c5d-4a72-b91b-bd7f21348ea0 with Priority: HIGHEST for action security_group_rules [ 635.940865] env[65337]: INFO networking_nsxv3.common.synchronization [req-22f48669-e9bc-488c-8c1a-d2273be2ed9a req-ca623377-b406-47b5-9c96-6e771d7cee77 service nova] Enqueued Resource ID: c26a679a-9c5d-4a72-b91b-bd7f21348ea0 with Priority: HIGHEST for action security_group_members [ 635.940865] env[65337]: INFO networking_nsxv3.common.synchronization [req-22f48669-e9bc-488c-8c1a-d2273be2ed9a req-ca623377-b406-47b5-9c96-6e771d7cee77 service nova] Enqueued Resource ID: e3036b3e-3979-4a9e-818c-8fa790d442c4 with Priority: HIGHEST for action port [ 635.940865] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c26a679a-9c5d-4a72-b91b-bd7f21348ea0 with Priority: HIGHEST for action security_group_rules [ 635.940865] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c26a679a-9c5d-4a72-b91b-bd7f21348ea0 with Priority: HIGHEST for action security_group_members [ 635.940865] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3036b3e-3979-4a9e-818c-8fa790d442c4 with Priority: HIGHEST for action port [ 635.941722] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c26a679a-9c5d-4a72-b91b-bd7f21348ea0 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.941722] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c26a679a-9c5d-4a72-b91b-bd7f21348ea0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.941722] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c26a679a-9c5d-4a72-b91b-bd7f21348ea0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.941722] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c26a679a-9c5d-4a72-b91b-bd7f21348ea0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.941722] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c26a679a-9c5d-4a72-b91b-bd7f21348ea0',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.942672] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-c26a679a-9c5d-4a72-b91b-bd7f21348ea0 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.942817] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c26a679a-9c5d-4a72-b91b-bd7f21348ea0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.942817] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c26a679a-9c5d-4a72-b91b-bd7f21348ea0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.942992] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c26a679a-9c5d-4a72-b91b-bd7f21348ea0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.943162] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.943258] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.943334] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.943458] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.943540] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.943661] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c26a679a-9c5d-4a72-b91b-bd7f21348ea0',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.945820] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-e3036b3e-3979-4a9e-818c-8fa790d442c4 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.945947] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e3036b3e-3979-4a9e-818c-8fa790d442c4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.946039] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e3036b3e-3979-4a9e-818c-8fa790d442c4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.946281] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e3036b3e-3979-4a9e-818c-8fa790d442c4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.946384] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e3036b3e-3979-4a9e-818c-8fa790d442c4',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.144442] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-b2e84376-5c9f-45e7-9949-59bf17a96c95 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.150266] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b2e84376-5c9f-45e7-9949-59bf17a96c95" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.150266] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b2e84376-5c9f-45e7-9949-59bf17a96c95" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.150266] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b2e84376-5c9f-45e7-9949-59bf17a96c95" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.150266] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.150266] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.150266] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.150266] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.150266] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.150266] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b2e84376-5c9f-45e7-9949-59bf17a96c95" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.150266] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-b2e84376-5c9f-45e7-9949-59bf17a96c95 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.150266] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b2e84376-5c9f-45e7-9949-59bf17a96c95" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.150266] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b2e84376-5c9f-45e7-9949-59bf17a96c95" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.150266] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b2e84376-5c9f-45e7-9949-59bf17a96c95" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.150266] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.150266] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.150266] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.151626] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.151935] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.152181] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b2e84376-5c9f-45e7-9949-59bf17a96c95" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.152374] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b2e84376-5c9f-45e7-9949-59bf17a96c95',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.160168] env[65337]: INFO networking_nsxv3.common.synchronization [None req-406defb3-ab67-44d3-98a7-3f1c651b963f None None] Enqueued Resource ID: 6de216cc-8ba8-4a9d-9792-33ee041335b3 with Priority: HIGHEST for action port [ 636.160168] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6de216cc-8ba8-4a9d-9792-33ee041335b3 with Priority: HIGHEST for action port [ 636.160463] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-6de216cc-8ba8-4a9d-9792-33ee041335b3 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.160791] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6de216cc-8ba8-4a9d-9792-33ee041335b3" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.160991] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6de216cc-8ba8-4a9d-9792-33ee041335b3" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.161728] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6de216cc-8ba8-4a9d-9792-33ee041335b3" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.161972] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6de216cc-8ba8-4a9d-9792-33ee041335b3',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.454862] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c26a679a-9c5d-4a72-b91b-bd7f21348ea0',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.454862] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-c26a679a-9c5d-4a72-b91b-bd7f21348ea0 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.454862] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c26a679a-9c5d-4a72-b91b-bd7f21348ea0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.454862] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e3036b3e-3979-4a9e-818c-8fa790d442c4 with status ACTIVE [ 636.454862] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.454862] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.454862] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.454862] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.454862] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.456886] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.457032] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.457191] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.458022] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.458022] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.458022] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.458022] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.458022] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.458330] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.458330] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.458391] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e3036b3e-3979-4a9e-818c-8fa790d442c4 is going to be updated. [ 636.488190] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.488190] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.488190] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.488190] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.488190] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.488190] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e3036b3e-3979-4a9e-818c-8fa790d442c4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.656104] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b2e84376-5c9f-45e7-9949-59bf17a96c95: rpc.has_security_group_logging(os_id): False [ 636.665027] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6de216cc-8ba8-4a9d-9792-33ee041335b3 [ 636.665546] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.665876] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.666627] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.666627] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.666627] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.666627] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6de216cc-8ba8-4a9d-9792-33ee041335b3 already deleted. [ 636.667029] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6de216cc-8ba8-4a9d-9792-33ee041335b3" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.680348] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.681049] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.681049] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.681049] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.681049] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.681248] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.681307] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.681340] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.681488] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.681566] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.681810] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.681915] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.681997] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.682166] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.682239] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.682764] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.682764] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.682764] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.682764] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.682977] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.685268] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b2e84376-5c9f-45e7-9949-59bf17a96c95 is going to be created. [ 636.769032] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.769032] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.769032] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.769032] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.769032] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.784620] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b2e84376-5c9f-45e7-9949-59bf17a96c95 in Status: IN_PROGRESS for 2s [ 636.960956] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c26a679a-9c5d-4a72-b91b-bd7f21348ea0',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.030781] env[65337]: INFO networking_nsxv3.common.synchronization [None req-4be01e26-df3c-497c-b50c-de58626b0cc4 None None] Enqueued Resource ID: d410d361-1d6e-4480-8be8-ddf483e61345 with Priority: HIGHEST for action port [ 637.034152] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d410d361-1d6e-4480-8be8-ddf483e61345 with Priority: HIGHEST for action port [ 637.034152] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-d410d361-1d6e-4480-8be8-ddf483e61345 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.034152] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d410d361-1d6e-4480-8be8-ddf483e61345" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.034152] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d410d361-1d6e-4480-8be8-ddf483e61345" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.034152] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d410d361-1d6e-4480-8be8-ddf483e61345" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.034152] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d410d361-1d6e-4480-8be8-ddf483e61345',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.463638] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.465084] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.465084] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.465084] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.465084] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.467139] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c26a679a-9c5d-4a72-b91b-bd7f21348ea0 is going to be created. [ 637.494878] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.496877] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.496877] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.496877] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.496877] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.508129] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c26a679a-9c5d-4a72-b91b-bd7f21348ea0 in Status: UNINITIALIZED for 2s [ 637.536302] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d410d361-1d6e-4480-8be8-ddf483e61345 [ 637.536302] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.536302] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.536302] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.536302] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.536302] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.536302] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d410d361-1d6e-4480-8be8-ddf483e61345 already deleted. [ 637.536302] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d410d361-1d6e-4480-8be8-ddf483e61345" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.893916] env[65337]: INFO networking_nsxv3.common.synchronization [None req-65f6094f-46f8-4239-94e8-d83b49ae2680 None None] Enqueued Resource ID: 98089e0d-8a43-400b-984f-0171c3f232d6 with Priority: HIGHEST for action port [ 637.894538] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98089e0d-8a43-400b-984f-0171c3f232d6 with Priority: HIGHEST for action port [ 637.894909] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-98089e0d-8a43-400b-984f-0171c3f232d6 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.895541] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-98089e0d-8a43-400b-984f-0171c3f232d6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.895799] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-98089e0d-8a43-400b-984f-0171c3f232d6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.895917] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-98089e0d-8a43-400b-984f-0171c3f232d6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.896028] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('98089e0d-8a43-400b-984f-0171c3f232d6',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.400916] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 98089e0d-8a43-400b-984f-0171c3f232d6 [ 638.400916] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.400916] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.400916] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.401174] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.401211] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.402214] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:98089e0d-8a43-400b-984f-0171c3f232d6 already deleted. [ 638.402214] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-98089e0d-8a43-400b-984f-0171c3f232d6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.793265] env[65337]: INFO networking_nsxv3.common.synchronization [None req-17b0ff95-be0c-4788-a538-6158478c499b None None] Enqueued Resource ID: 8514f3d6-2772-45b8-b6b4-573139578046 with Priority: HIGHEST for action port [ 638.796558] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8514f3d6-2772-45b8-b6b4-573139578046 with Priority: HIGHEST for action port [ 638.797894] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-8514f3d6-2772-45b8-b6b4-573139578046 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.798102] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8514f3d6-2772-45b8-b6b4-573139578046" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.798102] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8514f3d6-2772-45b8-b6b4-573139578046" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.798374] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8514f3d6-2772-45b8-b6b4-573139578046" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.799215] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8514f3d6-2772-45b8-b6b4-573139578046',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.808898] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b2e84376-5c9f-45e7-9949-59bf17a96c95 in Status: SUCCESS [ 638.809071] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b2e84376-5c9f-45e7-9949-59bf17a96c95" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.999863] env[65337]: INFO networking_nsxv3.common.synchronization [req-e5eb8959-669a-4377-881b-8653ffaceb3b req-95f321f5-12fd-429f-ac78-aac513039bd4 tempest-VolumesAdminNegativeTest-935490652 tempest-VolumesAdminNegativeTest-935490652-project-member] Enqueued Resource ID: 13c1490a-eab4-4d63-8d39-9071228c67fc with Priority: HIGHEST for action security_group_members [ 639.000508] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13c1490a-eab4-4d63-8d39-9071228c67fc with Priority: HIGHEST for action security_group_members [ 639.000861] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-13c1490a-eab4-4d63-8d39-9071228c67fc taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.000951] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-13c1490a-eab4-4d63-8d39-9071228c67fc" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.001045] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-13c1490a-eab4-4d63-8d39-9071228c67fc" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.001428] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-13c1490a-eab4-4d63-8d39-9071228c67fc" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.001642] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.001642] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.001752] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.002041] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.002041] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.002136] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('13c1490a-eab4-4d63-8d39-9071228c67fc',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.300883] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8514f3d6-2772-45b8-b6b4-573139578046 [ 639.304226] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.304226] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.304226] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.304226] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.304226] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.304226] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8514f3d6-2772-45b8-b6b4-573139578046 already deleted. [ 639.304226] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8514f3d6-2772-45b8-b6b4-573139578046" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.445032] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock network-501 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.445032] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "network-501" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.445032] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "network-501" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.445032] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "network-501" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.446167] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.448295] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.448422] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.448664] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.448801] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.449011] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 639.449117] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 639.449218] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 639.449316] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 639.449416] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 639.449511] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 639.449632] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 639.470083] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 639.470221] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 639.470364] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 639.470547] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "network-501" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.470914] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock port-592384a1-6150-48c6-abdc-44f973e35b22 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.471144] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "port-592384a1-6150-48c6-abdc-44f973e35b22" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.471279] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "port-592384a1-6150-48c6-abdc-44f973e35b22" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.471564] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "port-592384a1-6150-48c6-abdc-44f973e35b22" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.471700] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('592384a1-6150-48c6-abdc-44f973e35b22',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.505259] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.505410] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.505477] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.505724] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.505825] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.506641] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.506641] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.506641] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.506641] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.506641] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.506641] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 13c1490a-eab4-4d63-8d39-9071228c67fc already deleted. [ 639.506641] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-13c1490a-eab4-4d63-8d39-9071228c67fc" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.518829] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c26a679a-9c5d-4a72-b91b-bd7f21348ea0 in Status: SUCCESS [ 639.519140] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c26a679a-9c5d-4a72-b91b-bd7f21348ea0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.519365] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c26a679a-9c5d-4a72-b91b-bd7f21348ea0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.519623] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c26a679a-9c5d-4a72-b91b-bd7f21348ea0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.519890] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.520096] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.520201] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.520586] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.520586] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.520706] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c26a679a-9c5d-4a72-b91b-bd7f21348ea0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.520783] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c26a679a-9c5d-4a72-b91b-bd7f21348ea0',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.974863] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.975109] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.975233] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.975521] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.975639] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.975780] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Segment Port 592384a1-6150-48c6-abdc-44f973e35b22 not found, creating... [ 639.976058] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.976187] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.976297] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.977643] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.977643] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.977643] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.977643] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.977643] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.977643] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.977643] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.977896] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Resource: SegmentPort with ID: 592384a1-6150-48c6-abdc-44f973e35b22 is going to be created. [ 639.999617] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.999766] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.999811] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.000447] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.000447] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.001719] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "port-592384a1-6150-48c6-abdc-44f973e35b22" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.023948] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c26a679a-9c5d-4a72-b91b-bd7f21348ea0',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.528384] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c26a679a-9c5d-4a72-b91b-bd7f21348ea0: rpc.has_security_group_logging(os_id): False [ 640.548088] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.548266] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.548348] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.548737] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.548837] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.549257] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.549455] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.549528] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.549685] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.549768] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.549860] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c26a679a-9c5d-4a72-b91b-bd7f21348ea0 is going to be created. [ 640.622951] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.623125] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.623193] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.623393] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.623569] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.640197] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c26a679a-9c5d-4a72-b91b-bd7f21348ea0 in Status: IN_PROGRESS for 2s [ 640.775076] env[65337]: INFO networking_nsxv3.common.synchronization [req-e5eb8959-669a-4377-881b-8653ffaceb3b req-0045a65b-baf7-435f-80bc-0763c2df4600 service nova] Enqueued Resource ID: 13c1490a-eab4-4d63-8d39-9071228c67fc with Priority: HIGHEST for action security_group_rules [ 640.775076] env[65337]: INFO networking_nsxv3.common.synchronization [req-e5eb8959-669a-4377-881b-8653ffaceb3b req-0045a65b-baf7-435f-80bc-0763c2df4600 service nova] Enqueued Resource ID: 13c1490a-eab4-4d63-8d39-9071228c67fc with Priority: HIGHEST for action security_group_members [ 640.775326] env[65337]: INFO networking_nsxv3.common.synchronization [req-e5eb8959-669a-4377-881b-8653ffaceb3b req-0045a65b-baf7-435f-80bc-0763c2df4600 service nova] Enqueued Resource ID: 592384a1-6150-48c6-abdc-44f973e35b22 with Priority: HIGHEST for action port [ 640.776591] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13c1490a-eab4-4d63-8d39-9071228c67fc with Priority: HIGHEST for action security_group_rules [ 640.776679] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13c1490a-eab4-4d63-8d39-9071228c67fc with Priority: HIGHEST for action security_group_members [ 640.776787] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 592384a1-6150-48c6-abdc-44f973e35b22 with Priority: HIGHEST for action port [ 640.777373] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-13c1490a-eab4-4d63-8d39-9071228c67fc taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.777584] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-13c1490a-eab4-4d63-8d39-9071228c67fc" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.777643] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-13c1490a-eab4-4d63-8d39-9071228c67fc" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.778216] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-13c1490a-eab4-4d63-8d39-9071228c67fc" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.778216] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('13c1490a-eab4-4d63-8d39-9071228c67fc',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.780551] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-13c1490a-eab4-4d63-8d39-9071228c67fc taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.780551] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-13c1490a-eab4-4d63-8d39-9071228c67fc" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.780551] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-13c1490a-eab4-4d63-8d39-9071228c67fc" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.780551] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-13c1490a-eab4-4d63-8d39-9071228c67fc" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.780551] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.780551] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.780551] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.780551] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.780551] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.780551] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('13c1490a-eab4-4d63-8d39-9071228c67fc',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.783073] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-592384a1-6150-48c6-abdc-44f973e35b22 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.783073] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-592384a1-6150-48c6-abdc-44f973e35b22" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.783073] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-592384a1-6150-48c6-abdc-44f973e35b22" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.783073] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-592384a1-6150-48c6-abdc-44f973e35b22" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.783073] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('592384a1-6150-48c6-abdc-44f973e35b22',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.874658] env[65337]: INFO networking_nsxv3.common.synchronization [None req-5bc4b690-c724-4eaa-9862-8b98dc85946d None None] Enqueued Resource ID: e5826d48-32e1-4191-9648-1b2b528304d9 with Priority: HIGHEST for action port [ 640.875063] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5826d48-32e1-4191-9648-1b2b528304d9 with Priority: HIGHEST for action port [ 640.875428] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-e5826d48-32e1-4191-9648-1b2b528304d9 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.875519] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e5826d48-32e1-4191-9648-1b2b528304d9" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.875826] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e5826d48-32e1-4191-9648-1b2b528304d9" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.876079] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e5826d48-32e1-4191-9648-1b2b528304d9" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.876198] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e5826d48-32e1-4191-9648-1b2b528304d9',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.244326] env[65337]: INFO networking_nsxv3.common.synchronization [req-8684938d-5b6b-4400-b70c-9e6f3ed79b9b req-fbc2cbd6-0f81-4999-b7fb-8d923665018d tempest-ListImageFiltersTestJSON-525832378 tempest-ListImageFiltersTestJSON-525832378-project-member] Enqueued Resource ID: 2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24 with Priority: HIGHEST for action security_group_members [ 641.244938] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24 with Priority: HIGHEST for action security_group_members [ 641.245265] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.245383] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.245448] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.245663] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.245872] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.245963] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.246023] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.248186] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.248186] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.248186] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.284063] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-13c1490a-eab4-4d63-8d39-9071228c67fc taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.284063] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-13c1490a-eab4-4d63-8d39-9071228c67fc" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.285649] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('13c1490a-eab4-4d63-8d39-9071228c67fc',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.289032] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 592384a1-6150-48c6-abdc-44f973e35b22 with status ACTIVE [ 641.289032] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.289032] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.289032] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.289032] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.289032] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.289032] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.289032] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.289032] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.289469] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.289469] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.289469] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.289469] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.289469] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.289645] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.289685] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.289793] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 592384a1-6150-48c6-abdc-44f973e35b22 is going to be updated. [ 641.317271] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.317271] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.317271] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.317528] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.317695] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.317967] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-592384a1-6150-48c6-abdc-44f973e35b22" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.378914] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e5826d48-32e1-4191-9648-1b2b528304d9 [ 641.378914] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.378914] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.379243] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.379243] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.379308] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.379483] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e5826d48-32e1-4191-9648-1b2b528304d9 already deleted. [ 641.379483] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e5826d48-32e1-4191-9648-1b2b528304d9" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.643256] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock network-292 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.643575] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "network-292" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.643825] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "network-292" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.644239] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "network-292" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.645232] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.645582] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.645808] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.646614] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.646614] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.646614] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 641.646910] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 641.647057] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 641.647765] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 641.647765] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 641.647765] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 641.647765] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 641.668809] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 641.668975] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 641.669550] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 641.669550] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "network-292" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.669686] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock port-3292a9c5-4b97-4908-929a-5859a050e560 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.669771] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "port-3292a9c5-4b97-4908-929a-5859a050e560" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.669915] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "port-3292a9c5-4b97-4908-929a-5859a050e560" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.670317] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "port-3292a9c5-4b97-4908-929a-5859a050e560" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.670464] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3292a9c5-4b97-4908-929a-5859a050e560',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.728046] env[65337]: INFO networking_nsxv3.common.synchronization [req-abfbf1c3-0f52-4776-89ec-38142c4d1ab8 req-37aeb0b5-d22b-439d-9652-ff901280bf51 tempest-SecurityGroupRulesTestJSON-1213382043 tempest-SecurityGroupRulesTestJSON-1213382043-project-member] Enqueued Resource ID: 1731bbee-60b4-4db9-be23-293c96512dae with Priority: HIGHEST for action security_group_rules [ 641.728371] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1731bbee-60b4-4db9-be23-293c96512dae with Priority: HIGHEST for action security_group_rules [ 641.728690] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1731bbee-60b4-4db9-be23-293c96512dae taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.728819] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1731bbee-60b4-4db9-be23-293c96512dae" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.728885] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1731bbee-60b4-4db9-be23-293c96512dae" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.729146] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1731bbee-60b4-4db9-be23-293c96512dae" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.729301] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1731bbee-60b4-4db9-be23-293c96512dae',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.751112] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.792916] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('13c1490a-eab4-4d63-8d39-9071228c67fc',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.172464] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.173233] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.173785] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.175671] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.175671] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.175671] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Segment Port 3292a9c5-4b97-4908-929a-5859a050e560 not found, creating... [ 642.175671] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.175671] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.175671] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.175671] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.176382] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.176825] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.177222] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.177662] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.179747] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.179747] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.179747] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Resource: SegmentPort with ID: 3292a9c5-4b97-4908-929a-5859a050e560 is going to be created. [ 642.202025] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.202025] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.202025] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.202025] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.202025] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.202025] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "port-3292a9c5-4b97-4908-929a-5859a050e560" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.254050] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.260133] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.260133] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.260133] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.260133] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.260133] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.260133] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1731bbee-60b4-4db9-be23-293c96512dae already deleted. [ 642.260133] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1731bbee-60b4-4db9-be23-293c96512dae" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.296032] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.296281] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.296416] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.296748] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.296870] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.297060] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 13c1490a-eab4-4d63-8d39-9071228c67fc is going to be created. [ 642.353746] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.354092] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.354190] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.354506] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.354746] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.371318] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 13c1490a-eab4-4d63-8d39-9071228c67fc in Status: UNINITIALIZED for 2s [ 642.653912] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c26a679a-9c5d-4a72-b91b-bd7f21348ea0 in Status: SUCCESS [ 642.654216] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c26a679a-9c5d-4a72-b91b-bd7f21348ea0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.756446] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.756692] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.756692] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.756911] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.757014] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.757122] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24 is going to be updated. [ 642.790365] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.790590] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.790590] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.790895] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.790948] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.803116] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24 in Status: IN_PROGRESS for 2s [ 642.963236] env[65337]: INFO networking_nsxv3.common.synchronization [req-8684938d-5b6b-4400-b70c-9e6f3ed79b9b req-e0cf07a9-30d2-4f6e-9070-ee0abbe408fa service nova] Enqueued Resource ID: 2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24 with Priority: HIGHEST for action security_group_rules [ 642.963236] env[65337]: INFO networking_nsxv3.common.synchronization [req-8684938d-5b6b-4400-b70c-9e6f3ed79b9b req-e0cf07a9-30d2-4f6e-9070-ee0abbe408fa service nova] Enqueued Resource ID: 2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24 with Priority: HIGHEST for action security_group_members [ 642.963236] env[65337]: INFO networking_nsxv3.common.synchronization [req-8684938d-5b6b-4400-b70c-9e6f3ed79b9b req-e0cf07a9-30d2-4f6e-9070-ee0abbe408fa service nova] Enqueued Resource ID: 3292a9c5-4b97-4908-929a-5859a050e560 with Priority: HIGHEST for action port [ 642.963592] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24 with Priority: HIGHEST for action security_group_rules [ 642.963797] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24 with Priority: HIGHEST for action security_group_members [ 642.963912] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3292a9c5-4b97-4908-929a-5859a050e560 with Priority: HIGHEST for action port [ 642.964200] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.964549] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.964619] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.964823] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.967942] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.967942] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.967942] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.967942] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-3292a9c5-4b97-4908-929a-5859a050e560 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.967942] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3292a9c5-4b97-4908-929a-5859a050e560" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.967942] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3292a9c5-4b97-4908-929a-5859a050e560" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.967942] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3292a9c5-4b97-4908-929a-5859a050e560" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.967942] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3292a9c5-4b97-4908-929a-5859a050e560',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.387497] env[65337]: INFO networking_nsxv3.common.synchronization [req-d2a059e4-788f-4a1f-a198-bb76532a5096 req-65debd27-8263-44da-802b-fdb2a3299b5d tempest-ServerAddressesTestJSON-2058622675 tempest-ServerAddressesTestJSON-2058622675-project-member] Enqueued Resource ID: 51b69fea-e790-4b59-8a34-41bdb9264f84 with Priority: HIGHEST for action security_group_members [ 643.390024] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51b69fea-e790-4b59-8a34-41bdb9264f84 with Priority: HIGHEST for action security_group_members [ 643.391011] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-51b69fea-e790-4b59-8a34-41bdb9264f84 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.391011] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-51b69fea-e790-4b59-8a34-41bdb9264f84" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.391011] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-51b69fea-e790-4b59-8a34-41bdb9264f84" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.391785] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-51b69fea-e790-4b59-8a34-41bdb9264f84" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.391785] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.391785] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.391785] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.391785] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.391785] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.392100] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('51b69fea-e790-4b59-8a34-41bdb9264f84',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.469325] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.469500] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.469588] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3292a9c5-4b97-4908-929a-5859a050e560 with status ACTIVE [ 643.469815] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.469923] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.471199] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.471199] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.471199] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.471199] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.471199] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.471199] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.471199] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.471688] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.471688] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.471776] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.472590] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.472590] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.472590] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.472590] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3292a9c5-4b97-4908-929a-5859a050e560 is going to be updated. [ 643.499879] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.500076] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.500156] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.500446] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.500750] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.500878] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3292a9c5-4b97-4908-929a-5859a050e560" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.880396] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock network-410 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.880853] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "network-410" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.881028] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "network-410" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.881495] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "network-410" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.881953] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.882256] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.882476] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.882831] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.883088] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.883406] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 643.883594] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 643.883805] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 643.883995] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 643.884218] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 643.884414] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 643.884648] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 643.896276] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.896523] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.896566] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.896797] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.896887] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.897114] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.897243] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.897315] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.897517] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.897624] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.897689] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 51b69fea-e790-4b59-8a34-41bdb9264f84 already deleted. [ 643.897775] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-51b69fea-e790-4b59-8a34-41bdb9264f84" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.909420] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 643.909584] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 643.909902] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 643.910065] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "network-410" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.910404] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock port-a5dc1d8f-811e-4c68-8231-d11c87983800 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.910640] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "port-a5dc1d8f-811e-4c68-8231-d11c87983800" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.910759] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "port-a5dc1d8f-811e-4c68-8231-d11c87983800" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.911184] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "port-a5dc1d8f-811e-4c68-8231-d11c87983800" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.911290] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a5dc1d8f-811e-4c68-8231-d11c87983800',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.386047] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 13c1490a-eab4-4d63-8d39-9071228c67fc in Status: SUCCESS [ 644.386047] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-13c1490a-eab4-4d63-8d39-9071228c67fc" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.386047] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-13c1490a-eab4-4d63-8d39-9071228c67fc" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.386047] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-13c1490a-eab4-4d63-8d39-9071228c67fc" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.386047] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.386047] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.386047] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.386456] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.386456] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.386456] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-13c1490a-eab4-4d63-8d39-9071228c67fc" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.386456] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('13c1490a-eab4-4d63-8d39-9071228c67fc',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.414340] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.414625] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.414672] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.415015] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.415170] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.415321] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Segment Port a5dc1d8f-811e-4c68-8231-d11c87983800 not found, creating... [ 644.415576] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.415730] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.415856] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.416082] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.416216] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.416789] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.416789] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.416789] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.416983] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.417133] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.417269] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Resource: SegmentPort with ID: a5dc1d8f-811e-4c68-8231-d11c87983800 is going to be created. [ 644.437414] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.437691] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.437729] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.438058] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.438279] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.438546] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "port-a5dc1d8f-811e-4c68-8231-d11c87983800" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.818525] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24 in Status: SUCCESS [ 644.818525] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.818525] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.818525] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.818525] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.818525] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.818525] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.818525] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.818525] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.818525] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.889178] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-13c1490a-eab4-4d63-8d39-9071228c67fc taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.889711] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-13c1490a-eab4-4d63-8d39-9071228c67fc" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.889711] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-13c1490a-eab4-4d63-8d39-9071228c67fc" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.890120] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-13c1490a-eab4-4d63-8d39-9071228c67fc" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.890194] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.890272] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.890322] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.890456] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.890545] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.890634] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-13c1490a-eab4-4d63-8d39-9071228c67fc" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.890857] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-13c1490a-eab4-4d63-8d39-9071228c67fc taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.891400] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-13c1490a-eab4-4d63-8d39-9071228c67fc" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.891511] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-13c1490a-eab4-4d63-8d39-9071228c67fc" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.891701] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-13c1490a-eab4-4d63-8d39-9071228c67fc" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.891892] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.892064] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.892237] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.892296] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.892430] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.892676] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-13c1490a-eab4-4d63-8d39-9071228c67fc" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.892725] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('13c1490a-eab4-4d63-8d39-9071228c67fc',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.140382] env[65337]: INFO networking_nsxv3.common.synchronization [req-ff5f694c-3af3-4da6-9b31-07edba3308b4 req-f64c8af7-ffde-438f-87de-ec6c79add4d1 tempest-ServerDiagnosticsNegativeTest-1110258397 tempest-ServerDiagnosticsNegativeTest-1110258397-project-member] Enqueued Resource ID: 058c2139-5b77-4965-b2d8-ecc46af22480 with Priority: HIGHEST for action security_group_members [ 645.141301] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 058c2139-5b77-4965-b2d8-ecc46af22480 with Priority: HIGHEST for action security_group_members [ 645.141884] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-058c2139-5b77-4965-b2d8-ecc46af22480 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.142633] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-058c2139-5b77-4965-b2d8-ecc46af22480" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.142633] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-058c2139-5b77-4965-b2d8-ecc46af22480" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.142823] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-058c2139-5b77-4965-b2d8-ecc46af22480" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.143027] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.143118] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.143306] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.143413] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.143533] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.143702] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('058c2139-5b77-4965-b2d8-ecc46af22480',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.225500] env[65337]: INFO networking_nsxv3.common.synchronization [req-d2a059e4-788f-4a1f-a198-bb76532a5096 req-3ab30ac8-18c2-42cd-af3f-4a5761d96f58 service nova] Enqueued Resource ID: 51b69fea-e790-4b59-8a34-41bdb9264f84 with Priority: HIGHEST for action security_group_rules [ 645.225671] env[65337]: INFO networking_nsxv3.common.synchronization [req-d2a059e4-788f-4a1f-a198-bb76532a5096 req-3ab30ac8-18c2-42cd-af3f-4a5761d96f58 service nova] Enqueued Resource ID: 51b69fea-e790-4b59-8a34-41bdb9264f84 with Priority: HIGHEST for action security_group_members [ 645.227014] env[65337]: INFO networking_nsxv3.common.synchronization [req-d2a059e4-788f-4a1f-a198-bb76532a5096 req-3ab30ac8-18c2-42cd-af3f-4a5761d96f58 service nova] Enqueued Resource ID: a5dc1d8f-811e-4c68-8231-d11c87983800 with Priority: HIGHEST for action port [ 645.227014] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51b69fea-e790-4b59-8a34-41bdb9264f84 with Priority: HIGHEST for action security_group_rules [ 645.227014] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51b69fea-e790-4b59-8a34-41bdb9264f84 with Priority: HIGHEST for action security_group_members [ 645.227014] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5dc1d8f-811e-4c68-8231-d11c87983800 with Priority: HIGHEST for action port [ 645.227014] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-51b69fea-e790-4b59-8a34-41bdb9264f84 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.227014] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-51b69fea-e790-4b59-8a34-41bdb9264f84" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.227305] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-51b69fea-e790-4b59-8a34-41bdb9264f84" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.227446] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-51b69fea-e790-4b59-8a34-41bdb9264f84" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.227529] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('51b69fea-e790-4b59-8a34-41bdb9264f84',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.228405] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-51b69fea-e790-4b59-8a34-41bdb9264f84 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.228503] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-51b69fea-e790-4b59-8a34-41bdb9264f84" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.228571] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-51b69fea-e790-4b59-8a34-41bdb9264f84" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.228736] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-51b69fea-e790-4b59-8a34-41bdb9264f84" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.228882] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.228973] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.229096] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.229184] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.229509] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.229509] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('51b69fea-e790-4b59-8a34-41bdb9264f84',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.230945] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-a5dc1d8f-811e-4c68-8231-d11c87983800 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.230945] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a5dc1d8f-811e-4c68-8231-d11c87983800" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.230945] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a5dc1d8f-811e-4c68-8231-d11c87983800" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.230945] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a5dc1d8f-811e-4c68-8231-d11c87983800" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.230945] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a5dc1d8f-811e-4c68-8231-d11c87983800',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.320737] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.395403] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 13c1490a-eab4-4d63-8d39-9071228c67fc: rpc.has_security_group_logging(os_id): False [ 645.425034] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.425034] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.425034] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.425034] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.425034] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.425629] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.425629] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.425713] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.427630] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.427630] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.427630] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.427630] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.427630] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.427630] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.427630] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.427630] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.428122] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.428122] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.428122] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.428364] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.428430] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 13c1490a-eab4-4d63-8d39-9071228c67fc is going to be created. [ 645.501990] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.502289] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.502373] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.502947] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.503256] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.537598] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 13c1490a-eab4-4d63-8d39-9071228c67fc in Status: IN_PROGRESS for 2s [ 645.648337] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.648591] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.648790] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.649132] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.649132] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.650150] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.650150] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.650150] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.650418] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.650418] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.651288] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 058c2139-5b77-4965-b2d8-ecc46af22480 is going to be updated. [ 645.724172] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.724413] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.724498] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.724707] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.724841] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.734914] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 058c2139-5b77-4965-b2d8-ecc46af22480 in Status: IN_PROGRESS for 2s [ 645.735272] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-51b69fea-e790-4b59-8a34-41bdb9264f84 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.735413] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-51b69fea-e790-4b59-8a34-41bdb9264f84" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.735737] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('51b69fea-e790-4b59-8a34-41bdb9264f84',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.736799] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a5dc1d8f-811e-4c68-8231-d11c87983800 with status ACTIVE [ 645.737014] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.737144] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.737206] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.737420] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.737513] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.737750] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.738427] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.738427] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.740650] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.740791] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.741955] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.742159] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.742243] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.743071] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.743697] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.743697] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a5dc1d8f-811e-4c68-8231-d11c87983800 is going to be updated. [ 645.772363] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.772533] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.772606] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.772881] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.773079] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.773275] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a5dc1d8f-811e-4c68-8231-d11c87983800" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.823556] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.245626] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('51b69fea-e790-4b59-8a34-41bdb9264f84',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.325967] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.326278] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.326278] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.326467] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.326599] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.326666] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24 is going to be updated. [ 646.374734] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.374734] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.374734] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.374734] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.374734] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.387609] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24 in Status: IN_PROGRESS for 2s [ 646.748640] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.748948] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.748948] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.749135] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.749226] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.749444] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 51b69fea-e790-4b59-8a34-41bdb9264f84 is going to be created. [ 646.781318] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.781481] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.781598] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.781769] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.781930] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.795807] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 51b69fea-e790-4b59-8a34-41bdb9264f84 in Status: UNINITIALIZED for 2s [ 647.361192] env[65337]: INFO networking_nsxv3.common.synchronization [req-4ddaaeac-7730-40c6-a863-a69f31c58878 req-c182527e-e3de-44f2-ac6c-32ccca45727c tempest-SecurityGroupRulesTestJSON-1213382043 tempest-SecurityGroupRulesTestJSON-1213382043-project-member] Enqueued Resource ID: ec126920-b5f1-43fe-9c61-29f125a163d8 with Priority: HIGHEST for action security_group_rules [ 647.361878] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec126920-b5f1-43fe-9c61-29f125a163d8 with Priority: HIGHEST for action security_group_rules [ 647.364741] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ec126920-b5f1-43fe-9c61-29f125a163d8 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.364887] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ec126920-b5f1-43fe-9c61-29f125a163d8" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.364986] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ec126920-b5f1-43fe-9c61-29f125a163d8" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.365392] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ec126920-b5f1-43fe-9c61-29f125a163d8" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.365541] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ec126920-b5f1-43fe-9c61-29f125a163d8',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.552840] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 13c1490a-eab4-4d63-8d39-9071228c67fc in Status: SUCCESS [ 647.552840] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-13c1490a-eab4-4d63-8d39-9071228c67fc" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.748668] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 058c2139-5b77-4965-b2d8-ecc46af22480 in Status: SUCCESS [ 647.749122] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 058c2139-5b77-4965-b2d8-ecc46af22480 deletion is rescheduled due to dependency. [ 647.749122] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-058c2139-5b77-4965-b2d8-ecc46af22480" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.886416] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.886571] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.886623] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.886903] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.886986] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.887245] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ec126920-b5f1-43fe-9c61-29f125a163d8 already deleted. [ 647.887338] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ec126920-b5f1-43fe-9c61-29f125a163d8" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.398106] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24 in Status: SUCCESS [ 648.398449] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.399173] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.399443] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.400474] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.400575] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.400575] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.400740] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.400824] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.400909] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.401010] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.554143] env[65337]: INFO networking_nsxv3.common.synchronization [req-0d8571e8-01f2-4c82-aade-c78664a268ef req-0b273840-7386-40fe-bbc4-e181de89eece tempest-DeleteServersAdminTestJSON-1195367916 tempest-DeleteServersAdminTestJSON-1195367916-project-member] Enqueued Resource ID: a4c4fbaa-f4c9-4326-babb-bda6619acdf6 with Priority: HIGHEST for action security_group_members [ 648.555487] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4c4fbaa-f4c9-4326-babb-bda6619acdf6 with Priority: HIGHEST for action security_group_members [ 648.556136] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4c4fbaa-f4c9-4326-babb-bda6619acdf6 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.559459] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4c4fbaa-f4c9-4326-babb-bda6619acdf6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.559459] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4c4fbaa-f4c9-4326-babb-bda6619acdf6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.559459] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4c4fbaa-f4c9-4326-babb-bda6619acdf6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.559459] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.559459] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.559459] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.559459] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.559459] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.559459] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a4c4fbaa-f4c9-4326-babb-bda6619acdf6',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.806442] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 51b69fea-e790-4b59-8a34-41bdb9264f84 in Status: SUCCESS [ 648.806764] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-51b69fea-e790-4b59-8a34-41bdb9264f84" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.806854] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-51b69fea-e790-4b59-8a34-41bdb9264f84" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.807282] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-51b69fea-e790-4b59-8a34-41bdb9264f84" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.807386] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.807457] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.807821] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.807821] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.807821] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.807969] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-51b69fea-e790-4b59-8a34-41bdb9264f84" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.807969] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('51b69fea-e790-4b59-8a34-41bdb9264f84',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.825818] env[65337]: INFO networking_nsxv3.common.synchronization [req-b27c3555-03d4-4924-a38d-06736aae3a60 req-1dc1692d-d59b-4c23-a5c6-291001454597 tempest-ServerDiagnosticsTest-117228076 tempest-ServerDiagnosticsTest-117228076-project-member] Enqueued Resource ID: 9282454d-037f-4e64-902c-636a49b89434 with Priority: HIGHEST for action security_group_members [ 648.826369] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9282454d-037f-4e64-902c-636a49b89434 with Priority: HIGHEST for action security_group_members [ 648.826890] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-9282454d-037f-4e64-902c-636a49b89434 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.827064] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9282454d-037f-4e64-902c-636a49b89434" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.827125] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9282454d-037f-4e64-902c-636a49b89434" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.827350] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9282454d-037f-4e64-902c-636a49b89434" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.827508] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.827604] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.827668] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.828363] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.828363] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.829415] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9282454d-037f-4e64-902c-636a49b89434',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.906436] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.906436] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.906436] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.906436] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.906436] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.906436] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.906436] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.906436] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.906436] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.906436] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.906436] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.906436] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.906436] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.906436] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.906436] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.906436] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.907737] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.907737] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.907737] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.907737] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.907737] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.061574] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.061574] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.061574] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.061917] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.062886] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.062939] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.063036] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.063099] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.063280] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.063394] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.063706] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4c4fbaa-f4c9-4326-babb-bda6619acdf6 is going to be updated. [ 649.094025] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.094025] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.094025] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.094025] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.094025] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.108014] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4c4fbaa-f4c9-4326-babb-bda6619acdf6 in Status: IN_PROGRESS for 2s [ 649.310824] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-51b69fea-e790-4b59-8a34-41bdb9264f84 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.310824] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-51b69fea-e790-4b59-8a34-41bdb9264f84" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.310824] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-51b69fea-e790-4b59-8a34-41bdb9264f84" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.311101] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-51b69fea-e790-4b59-8a34-41bdb9264f84" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.311101] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.311258] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.311313] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.311444] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.311626] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.311716] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-51b69fea-e790-4b59-8a34-41bdb9264f84" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.311826] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-51b69fea-e790-4b59-8a34-41bdb9264f84 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.312388] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-51b69fea-e790-4b59-8a34-41bdb9264f84" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.312388] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-51b69fea-e790-4b59-8a34-41bdb9264f84" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.312388] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-51b69fea-e790-4b59-8a34-41bdb9264f84" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.312388] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.312388] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.312689] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.312689] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.312754] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.312831] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-51b69fea-e790-4b59-8a34-41bdb9264f84" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.312951] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('51b69fea-e790-4b59-8a34-41bdb9264f84',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.332101] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.332101] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.332101] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.332101] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.332101] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.332446] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.332446] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.332446] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.332446] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.332594] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.332629] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9282454d-037f-4e64-902c-636a49b89434 is going to be updated. [ 649.383966] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.384134] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.384202] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.384417] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.384561] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.396481] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9282454d-037f-4e64-902c-636a49b89434 in Status: IN_PROGRESS for 2s [ 649.409358] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24: rpc.has_security_group_logging(os_id): False [ 649.440473] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.440473] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.440473] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.440473] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.440473] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.440473] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.440473] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.440924] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.440924] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.440924] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.441583] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.441583] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.441742] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.441810] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.442120] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.442421] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.442683] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.442683] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.443266] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.443266] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.443266] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24 is going to be updated. [ 649.462247] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock network-292 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.462456] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "network-292" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.462583] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "network-292" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.463289] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "network-292" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.463591] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.463831] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.463953] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.464219] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.464360] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.464564] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 649.464683] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 649.464789] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 649.464922] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 649.465075] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 649.465169] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 649.465239] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 649.502320] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 649.502320] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Cache value generated in 0.036 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 649.502320] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 649.502320] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "network-292" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.502618] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock port-429c0e80-c26f-4ecf-9a7e-de161e9ed19b taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.502618] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "port-429c0e80-c26f-4ecf-9a7e-de161e9ed19b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.502847] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "port-429c0e80-c26f-4ecf-9a7e-de161e9ed19b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.503232] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "port-429c0e80-c26f-4ecf-9a7e-de161e9ed19b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.503317] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('429c0e80-c26f-4ecf-9a7e-de161e9ed19b',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.555699] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.555945] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.556074] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.556308] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.556491] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.577545] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24 in Status: IN_PROGRESS for 2s [ 649.815782] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 51b69fea-e790-4b59-8a34-41bdb9264f84: rpc.has_security_group_logging(os_id): False [ 649.837646] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.837856] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.837967] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.838379] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.838526] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.838801] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.839242] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.839242] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.839370] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.839370] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.839600] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.839761] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.839842] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.840034] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.840116] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.840304] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.840404] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.840471] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.840622] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.840699] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.840847] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 51b69fea-e790-4b59-8a34-41bdb9264f84 is going to be created. [ 649.920807] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.920807] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.920807] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.920807] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.920807] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.933186] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 51b69fea-e790-4b59-8a34-41bdb9264f84 in Status: IN_PROGRESS for 2s [ 650.005672] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.005913] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.006046] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.006370] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.006603] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.006855] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Segment Port 429c0e80-c26f-4ecf-9a7e-de161e9ed19b not found, creating... [ 650.007168] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.007388] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.007455] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.007698] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.007872] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.008245] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.008370] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.008503] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.008737] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.008888] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.009221] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Resource: SegmentPort with ID: 429c0e80-c26f-4ecf-9a7e-de161e9ed19b is going to be created. [ 650.057300] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.057753] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.057753] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.058729] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.058729] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.058729] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "port-429c0e80-c26f-4ecf-9a7e-de161e9ed19b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.078789] env[65337]: INFO networking_nsxv3.common.synchronization [req-6c3248da-4759-4b54-9003-a9e1f5c65b2b req-594594c8-8eeb-4d59-89c9-b11cc0029114 tempest-ImagesTestJSON-1531636912 tempest-ImagesTestJSON-1531636912-project-member] Enqueued Resource ID: 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 with Priority: HIGHEST for action security_group_members [ 650.079858] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 with Priority: HIGHEST for action security_group_members [ 650.079858] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.079858] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.080080] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.080175] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.080415] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.080528] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.080649] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.080738] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.080842] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.080927] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7db87dc2-69af-45f1-90c2-f8a4ec96c3b7',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.583697] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.583697] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.584045] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.584352] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.584957] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.584957] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.585118] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.585322] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.585563] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.585641] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.585726] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 is going to be updated. [ 650.617047] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.617274] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.617274] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.617456] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.618293] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.628040] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 in Status: IN_PROGRESS for 2s [ 650.745970] env[65337]: INFO networking_nsxv3.common.synchronization [req-0d8571e8-01f2-4c82-aade-c78664a268ef req-1dfc7ff9-ae4c-45bf-879d-cfa1484815f0 service nova] Enqueued Resource ID: a4c4fbaa-f4c9-4326-babb-bda6619acdf6 with Priority: HIGHEST for action security_group_rules [ 650.746353] env[65337]: INFO networking_nsxv3.common.synchronization [req-0d8571e8-01f2-4c82-aade-c78664a268ef req-1dfc7ff9-ae4c-45bf-879d-cfa1484815f0 service nova] Enqueued Resource ID: a4c4fbaa-f4c9-4326-babb-bda6619acdf6 with Priority: HIGHEST for action security_group_members [ 650.746703] env[65337]: INFO networking_nsxv3.common.synchronization [req-0d8571e8-01f2-4c82-aade-c78664a268ef req-1dfc7ff9-ae4c-45bf-879d-cfa1484815f0 service nova] Enqueued Resource ID: 429c0e80-c26f-4ecf-9a7e-de161e9ed19b with Priority: HIGHEST for action port [ 650.747041] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4c4fbaa-f4c9-4326-babb-bda6619acdf6 with Priority: HIGHEST for action security_group_rules [ 650.747293] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4c4fbaa-f4c9-4326-babb-bda6619acdf6 with Priority: HIGHEST for action security_group_members [ 650.747293] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 429c0e80-c26f-4ecf-9a7e-de161e9ed19b with Priority: HIGHEST for action port [ 650.747574] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a4c4fbaa-f4c9-4326-babb-bda6619acdf6 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.747734] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a4c4fbaa-f4c9-4326-babb-bda6619acdf6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.747874] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a4c4fbaa-f4c9-4326-babb-bda6619acdf6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.747973] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a4c4fbaa-f4c9-4326-babb-bda6619acdf6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.748073] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a4c4fbaa-f4c9-4326-babb-bda6619acdf6',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.748973] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4c4fbaa-f4c9-4326-babb-bda6619acdf6 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.749089] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4c4fbaa-f4c9-4326-babb-bda6619acdf6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.749295] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-429c0e80-c26f-4ecf-9a7e-de161e9ed19b taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.749389] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-429c0e80-c26f-4ecf-9a7e-de161e9ed19b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.749463] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-429c0e80-c26f-4ecf-9a7e-de161e9ed19b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.749629] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-429c0e80-c26f-4ecf-9a7e-de161e9ed19b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.749698] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('429c0e80-c26f-4ecf-9a7e-de161e9ed19b',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.128998] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4c4fbaa-f4c9-4326-babb-bda6619acdf6 in Status: SUCCESS [ 651.129307] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4c4fbaa-f4c9-4326-babb-bda6619acdf6 deletion is rescheduled due to dependency. [ 651.129379] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4c4fbaa-f4c9-4326-babb-bda6619acdf6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.129551] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4c4fbaa-f4c9-4326-babb-bda6619acdf6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.129763] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4c4fbaa-f4c9-4326-babb-bda6619acdf6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.130025] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.130204] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.130277] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.130707] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.130838] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.130939] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a4c4fbaa-f4c9-4326-babb-bda6619acdf6',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.251541] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4c4fbaa-f4c9-4326-babb-bda6619acdf6 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.251811] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4c4fbaa-f4c9-4326-babb-bda6619acdf6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.251883] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 429c0e80-c26f-4ecf-9a7e-de161e9ed19b with status ACTIVE [ 651.252048] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.252176] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.252265] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.252447] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.252536] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.252881] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.252881] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.252881] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.253148] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.253148] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.253290] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.253396] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.253450] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.253596] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.253673] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.253767] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 429c0e80-c26f-4ecf-9a7e-de161e9ed19b is going to be updated. [ 651.285944] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.286526] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.286526] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.286526] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.286782] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.286919] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-429c0e80-c26f-4ecf-9a7e-de161e9ed19b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.414192] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9282454d-037f-4e64-902c-636a49b89434 in Status: SUCCESS [ 651.414364] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9282454d-037f-4e64-902c-636a49b89434 deletion is rescheduled due to dependency. [ 651.414476] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9282454d-037f-4e64-902c-636a49b89434" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.593483] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24 in Status: SUCCESS [ 651.593483] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.635700] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a4c4fbaa-f4c9-4326-babb-bda6619acdf6',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.945822] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 51b69fea-e790-4b59-8a34-41bdb9264f84 in Status: SUCCESS [ 651.945982] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-51b69fea-e790-4b59-8a34-41bdb9264f84" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.962969] env[65337]: INFO networking_nsxv3.common.synchronization [req-2cd70926-26d7-47ec-9ed0-3a5669ce961e req-f25682b5-198c-4f2e-87e9-52d08f96147c tempest-ServersAdminTestJSON-283641549 tempest-ServersAdminTestJSON-283641549-project-member] Enqueued Resource ID: 9e889ce7-965a-4de0-b096-60d4e743cf8b with Priority: HIGHEST for action security_group_members [ 651.963425] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e889ce7-965a-4de0-b096-60d4e743cf8b with Priority: HIGHEST for action security_group_members [ 651.963747] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e889ce7-965a-4de0-b096-60d4e743cf8b taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.963870] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.963951] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.964210] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.964366] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.964464] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.964559] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.964671] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.964780] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.964874] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e889ce7-965a-4de0-b096-60d4e743cf8b',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.137475] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a4c4fbaa-f4c9-4326-babb-bda6619acdf6',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.467351] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.467537] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.467587] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.469452] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.469452] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.469452] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.469452] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.469452] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.469452] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.469452] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.469452] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e889ce7-965a-4de0-b096-60d4e743cf8b already deleted. [ 652.469452] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.518319] env[65337]: INFO networking_nsxv3.common.synchronization [None req-a29ec37f-c467-4d2b-ae23-02ae465ae791 None None] Enqueued Resource ID: f9610b48-2efc-46bc-be87-447328e1403f with Priority: HIGHEST for action port [ 652.519147] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9610b48-2efc-46bc-be87-447328e1403f with Priority: HIGHEST for action port [ 652.519231] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-f9610b48-2efc-46bc-be87-447328e1403f taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.519380] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f9610b48-2efc-46bc-be87-447328e1403f" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.519380] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f9610b48-2efc-46bc-be87-447328e1403f" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.519735] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f9610b48-2efc-46bc-be87-447328e1403f" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.519735] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f9610b48-2efc-46bc-be87-447328e1403f',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.639496] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 in Status: SUCCESS [ 652.641812] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 deletion is rescheduled due to dependency. [ 652.641812] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.641812] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.641812] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.641812] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.641812] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.641812] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.641812] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4c4fbaa-f4c9-4326-babb-bda6619acdf6 is going to be updated. [ 652.676494] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.676494] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.676750] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.677183] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.677183] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.690934] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4c4fbaa-f4c9-4326-babb-bda6619acdf6 in Status: IN_PROGRESS for 2s [ 652.960830] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock network-366 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.961035] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "network-366" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.962264] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "network-366" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.962758] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "network-366" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.963101] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.963311] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.963484] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.963812] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.964011] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.964256] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 652.964401] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 652.964533] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 652.964727] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 652.964878] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 652.965057] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 652.965231] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 652.984961] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 652.985139] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 652.985279] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 652.985447] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "network-366" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.985760] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock port-bb2356bf-ec27-4f8c-8e1a-cb3a9a1e25f5 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.985929] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "port-bb2356bf-ec27-4f8c-8e1a-cb3a9a1e25f5" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.986054] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "port-bb2356bf-ec27-4f8c-8e1a-cb3a9a1e25f5" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.986654] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "port-bb2356bf-ec27-4f8c-8e1a-cb3a9a1e25f5" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.986654] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bb2356bf-ec27-4f8c-8e1a-cb3a9a1e25f5',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.022346] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f9610b48-2efc-46bc-be87-447328e1403f [ 653.022587] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.022724] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.022786] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.022993] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.023090] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.023183] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f9610b48-2efc-46bc-be87-447328e1403f already deleted. [ 653.023262] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f9610b48-2efc-46bc-be87-447328e1403f" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.249827] env[65337]: INFO networking_nsxv3.common.synchronization [None req-43b494b2-e3a5-427e-b22c-811e67ee58ba None None] Enqueued Resource ID: 733aa0c6-4b0f-4e6c-98de-be6ba7e1927e with Priority: HIGHEST for action port [ 653.250439] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 733aa0c6-4b0f-4e6c-98de-be6ba7e1927e with Priority: HIGHEST for action port [ 653.250651] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-733aa0c6-4b0f-4e6c-98de-be6ba7e1927e taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.250780] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-733aa0c6-4b0f-4e6c-98de-be6ba7e1927e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.250841] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-733aa0c6-4b0f-4e6c-98de-be6ba7e1927e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.252165] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-733aa0c6-4b0f-4e6c-98de-be6ba7e1927e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.252165] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('733aa0c6-4b0f-4e6c-98de-be6ba7e1927e',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.492349] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.492349] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.492349] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.492349] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.492349] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.492349] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Segment Port bb2356bf-ec27-4f8c-8e1a-cb3a9a1e25f5 not found, creating... [ 653.492349] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.492349] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.492349] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.493178] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.493178] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.493367] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.493612] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.493912] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.494191] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.494395] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.494567] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Resource: SegmentPort with ID: bb2356bf-ec27-4f8c-8e1a-cb3a9a1e25f5 is going to be created. [ 653.517891] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.518197] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.518344] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.518669] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.518958] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.520366] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "port-bb2356bf-ec27-4f8c-8e1a-cb3a9a1e25f5" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.756597] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 733aa0c6-4b0f-4e6c-98de-be6ba7e1927e [ 653.756883] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.757070] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.757138] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.757356] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.757482] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.757603] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:733aa0c6-4b0f-4e6c-98de-be6ba7e1927e already deleted. [ 653.757693] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-733aa0c6-4b0f-4e6c-98de-be6ba7e1927e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.262155] env[65337]: INFO networking_nsxv3.common.synchronization [req-2cd70926-26d7-47ec-9ed0-3a5669ce961e req-4c8a61a9-18b3-4bf1-b8e7-3017bf7c59af service nova] Enqueued Resource ID: 9e889ce7-965a-4de0-b096-60d4e743cf8b with Priority: HIGHEST for action security_group_rules [ 654.262485] env[65337]: INFO networking_nsxv3.common.synchronization [req-2cd70926-26d7-47ec-9ed0-3a5669ce961e req-4c8a61a9-18b3-4bf1-b8e7-3017bf7c59af service nova] Enqueued Resource ID: 9e889ce7-965a-4de0-b096-60d4e743cf8b with Priority: HIGHEST for action security_group_members [ 654.262485] env[65337]: INFO networking_nsxv3.common.synchronization [req-2cd70926-26d7-47ec-9ed0-3a5669ce961e req-4c8a61a9-18b3-4bf1-b8e7-3017bf7c59af service nova] Enqueued Resource ID: bb2356bf-ec27-4f8c-8e1a-cb3a9a1e25f5 with Priority: HIGHEST for action port [ 654.263243] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e889ce7-965a-4de0-b096-60d4e743cf8b with Priority: HIGHEST for action security_group_rules [ 654.264238] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e889ce7-965a-4de0-b096-60d4e743cf8b with Priority: HIGHEST for action security_group_members [ 654.264302] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb2356bf-ec27-4f8c-8e1a-cb3a9a1e25f5 with Priority: HIGHEST for action port [ 654.264700] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9e889ce7-965a-4de0-b096-60d4e743cf8b taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.264894] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.265436] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.266314] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.266314] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9e889ce7-965a-4de0-b096-60d4e743cf8b',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.267954] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e889ce7-965a-4de0-b096-60d4e743cf8b taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.267954] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.269041] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.270610] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.270610] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.270610] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.270610] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.270610] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.270610] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.270610] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e889ce7-965a-4de0-b096-60d4e743cf8b',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.274542] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-bb2356bf-ec27-4f8c-8e1a-cb3a9a1e25f5 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.274706] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bb2356bf-ec27-4f8c-8e1a-cb3a9a1e25f5" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.274796] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bb2356bf-ec27-4f8c-8e1a-cb3a9a1e25f5" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.275118] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bb2356bf-ec27-4f8c-8e1a-cb3a9a1e25f5" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.275118] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bb2356bf-ec27-4f8c-8e1a-cb3a9a1e25f5',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.702181] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4c4fbaa-f4c9-4326-babb-bda6619acdf6 in Status: SUCCESS [ 654.702431] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4c4fbaa-f4c9-4326-babb-bda6619acdf6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.702642] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4c4fbaa-f4c9-4326-babb-bda6619acdf6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.702946] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4c4fbaa-f4c9-4326-babb-bda6619acdf6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.703177] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.703292] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.703353] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.703512] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.703588] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.703676] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4c4fbaa-f4c9-4326-babb-bda6619acdf6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.703936] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a4c4fbaa-f4c9-4326-babb-bda6619acdf6',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.775198] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9e889ce7-965a-4de0-b096-60d4e743cf8b',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.776530] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e889ce7-965a-4de0-b096-60d4e743cf8b taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.776667] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.777017] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bb2356bf-ec27-4f8c-8e1a-cb3a9a1e25f5 with status ACTIVE [ 654.777575] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.777575] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.777575] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.777776] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.777776] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.778337] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.778337] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.778337] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.778337] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.778561] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.778738] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.778738] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.778738] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.779082] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.779082] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.779082] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bb2356bf-ec27-4f8c-8e1a-cb3a9a1e25f5 is going to be updated. [ 654.803446] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.803446] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.803446] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.803446] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.803446] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.803446] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bb2356bf-ec27-4f8c-8e1a-cb3a9a1e25f5" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.826043] env[65337]: INFO networking_nsxv3.common.synchronization [None req-a9790940-4902-48b6-bb2f-5d5846c9ba8a None None] Enqueued Resource ID: b5b1c251-a07b-4918-b863-be33de7dac54 with Priority: HIGHEST for action port [ 654.826043] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5b1c251-a07b-4918-b863-be33de7dac54 with Priority: HIGHEST for action port [ 654.826470] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-b5b1c251-a07b-4918-b863-be33de7dac54 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.826757] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b5b1c251-a07b-4918-b863-be33de7dac54" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.827353] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b5b1c251-a07b-4918-b863-be33de7dac54" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.827756] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b5b1c251-a07b-4918-b863-be33de7dac54" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.828146] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b5b1c251-a07b-4918-b863-be33de7dac54',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.114951] env[65337]: INFO networking_nsxv3.common.synchronization [req-90012298-5742-440a-a9f4-6d2537586d47 req-51d6810d-06e1-4046-be58-8d1af99fa987 tempest-ServersAdminTestJSON-283641549 tempest-ServersAdminTestJSON-283641549-project-member] Enqueued Resource ID: 9e889ce7-965a-4de0-b096-60d4e743cf8b with Priority: HIGHEST for action security_group_members [ 655.115456] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e889ce7-965a-4de0-b096-60d4e743cf8b with Priority: HIGHEST for action security_group_members [ 655.115765] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e889ce7-965a-4de0-b096-60d4e743cf8b taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.115986] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.137135] env[65337]: INFO networking_nsxv3.common.synchronization [None req-113d333e-872e-49a1-88ce-cbf9fb6ca65d None None] Enqueued Resource ID: 65b790ca-4abb-4cef-95bd-793a5b016b85 with Priority: HIGHEST for action port [ 655.137135] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65b790ca-4abb-4cef-95bd-793a5b016b85 with Priority: HIGHEST for action port [ 655.137135] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-65b790ca-4abb-4cef-95bd-793a5b016b85 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.137135] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-65b790ca-4abb-4cef-95bd-793a5b016b85" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.137135] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-65b790ca-4abb-4cef-95bd-793a5b016b85" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.137676] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-65b790ca-4abb-4cef-95bd-793a5b016b85" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.137676] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('65b790ca-4abb-4cef-95bd-793a5b016b85',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.207342] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4c4fbaa-f4c9-4326-babb-bda6619acdf6 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.207342] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4c4fbaa-f4c9-4326-babb-bda6619acdf6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.207512] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4c4fbaa-f4c9-4326-babb-bda6619acdf6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.207598] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4c4fbaa-f4c9-4326-babb-bda6619acdf6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.208711] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.208711] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.208711] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.208711] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.208711] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.208711] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4c4fbaa-f4c9-4326-babb-bda6619acdf6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.208711] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4c4fbaa-f4c9-4326-babb-bda6619acdf6 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.208711] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4c4fbaa-f4c9-4326-babb-bda6619acdf6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.208711] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4c4fbaa-f4c9-4326-babb-bda6619acdf6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.208711] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4c4fbaa-f4c9-4326-babb-bda6619acdf6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.209120] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.209120] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.209120] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.209120] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.209120] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.209289] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4c4fbaa-f4c9-4326-babb-bda6619acdf6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.209289] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a4c4fbaa-f4c9-4326-babb-bda6619acdf6',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.277966] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9e889ce7-965a-4de0-b096-60d4e743cf8b',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.332792] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b5b1c251-a07b-4918-b863-be33de7dac54 [ 655.332792] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.332792] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.333090] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.333751] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.333871] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.334322] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b5b1c251-a07b-4918-b863-be33de7dac54 already deleted. [ 655.334322] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b5b1c251-a07b-4918-b863-be33de7dac54" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.538222] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock network-366 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.538222] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "network-366" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.538222] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "network-366" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.538222] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "network-366" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.538222] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.538222] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.538222] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.540129] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.540735] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.541141] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 655.541361] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 655.541592] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 655.541789] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 655.542020] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 655.542229] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 655.542459] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 655.604674] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 655.604934] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Cache value generated in 0.062 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 655.605135] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 655.605320] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "network-366" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.605643] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock port-b2edef2f-e92d-4702-99d0-f3c32b9c1137 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.605817] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "port-b2edef2f-e92d-4702-99d0-f3c32b9c1137" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.605994] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "port-b2edef2f-e92d-4702-99d0-f3c32b9c1137" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.606289] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "port-b2edef2f-e92d-4702-99d0-f3c32b9c1137" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.606424] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b2edef2f-e92d-4702-99d0-f3c32b9c1137',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.640200] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 65b790ca-4abb-4cef-95bd-793a5b016b85 [ 655.640497] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.640648] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.640725] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.640957] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.641079] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.641180] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:65b790ca-4abb-4cef-95bd-793a5b016b85 already deleted. [ 655.641265] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-65b790ca-4abb-4cef-95bd-793a5b016b85" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.714553] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a4c4fbaa-f4c9-4326-babb-bda6619acdf6: rpc.has_security_group_logging(os_id): False [ 655.734721] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.735967] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.735967] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.735967] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.735967] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.735967] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.735967] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.735967] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.735967] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.735967] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.735967] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.736496] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.736496] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.736496] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.736496] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.736496] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.736700] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.736700] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.736921] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.736921] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.737574] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a4c4fbaa-f4c9-4326-babb-bda6619acdf6 is going to be updated. [ 655.781853] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.782071] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.782147] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.782473] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.782537] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.782602] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e889ce7-965a-4de0-b096-60d4e743cf8b is going to be created. [ 655.808659] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.808893] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.808977] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.809172] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.809595] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.812207] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.812419] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.812495] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.812748] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.812865] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.827069] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e889ce7-965a-4de0-b096-60d4e743cf8b in Status: UNINITIALIZED for 2s [ 655.829592] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a4c4fbaa-f4c9-4326-babb-bda6619acdf6 in Status: IN_PROGRESS for 2s [ 656.110664] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.110664] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.110937] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.111252] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.111509] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.111803] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Segment Port b2edef2f-e92d-4702-99d0-f3c32b9c1137 not found, creating... [ 656.112187] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.112505] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.112726] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.113149] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.113483] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.114767] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.114767] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.114767] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.114767] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.115143] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.115281] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Resource: SegmentPort with ID: b2edef2f-e92d-4702-99d0-f3c32b9c1137 is going to be created. [ 656.138140] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.138383] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.138504] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.138777] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.139018] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.139244] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "port-b2edef2f-e92d-4702-99d0-f3c32b9c1137" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.829386] env[65337]: INFO networking_nsxv3.common.synchronization [req-90012298-5742-440a-a9f4-6d2537586d47 req-cb99a92d-9c8d-42fc-97a4-6df117ec9991 service nova] Enqueued Resource ID: 9e889ce7-965a-4de0-b096-60d4e743cf8b with Priority: HIGHEST for action security_group_rules [ 656.829653] env[65337]: INFO networking_nsxv3.common.synchronization [req-90012298-5742-440a-a9f4-6d2537586d47 req-cb99a92d-9c8d-42fc-97a4-6df117ec9991 service nova] Enqueued Resource ID: 9e889ce7-965a-4de0-b096-60d4e743cf8b with Priority: HIGHEST for action security_group_members [ 656.829697] env[65337]: INFO networking_nsxv3.common.synchronization [req-90012298-5742-440a-a9f4-6d2537586d47 req-cb99a92d-9c8d-42fc-97a4-6df117ec9991 service nova] Enqueued Resource ID: b2edef2f-e92d-4702-99d0-f3c32b9c1137 with Priority: HIGHEST for action port [ 656.830248] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e889ce7-965a-4de0-b096-60d4e743cf8b with Priority: HIGHEST for action security_group_rules [ 656.830383] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e889ce7-965a-4de0-b096-60d4e743cf8b with Priority: HIGHEST for action security_group_members [ 656.830477] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2edef2f-e92d-4702-99d0-f3c32b9c1137 with Priority: HIGHEST for action port [ 656.830790] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9e889ce7-965a-4de0-b096-60d4e743cf8b taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.830871] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.831169] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e889ce7-965a-4de0-b096-60d4e743cf8b taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.831613] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.831613] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-b2edef2f-e92d-4702-99d0-f3c32b9c1137 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.831613] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b2edef2f-e92d-4702-99d0-f3c32b9c1137" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.831894] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b2edef2f-e92d-4702-99d0-f3c32b9c1137" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.831894] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b2edef2f-e92d-4702-99d0-f3c32b9c1137" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.831979] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b2edef2f-e92d-4702-99d0-f3c32b9c1137',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.001151] env[65337]: INFO networking_nsxv3.common.synchronization [None req-c6593980-d6cc-4e1d-89e7-84cb6b44963d None None] Enqueued Resource ID: be8ed8c2-ab3e-4a60-bf7c-cfb7f1d66fc7 with Priority: HIGHEST for action port [ 657.001713] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be8ed8c2-ab3e-4a60-bf7c-cfb7f1d66fc7 with Priority: HIGHEST for action port [ 657.002022] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-be8ed8c2-ab3e-4a60-bf7c-cfb7f1d66fc7 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.002137] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-be8ed8c2-ab3e-4a60-bf7c-cfb7f1d66fc7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.002194] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-be8ed8c2-ab3e-4a60-bf7c-cfb7f1d66fc7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.002439] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-be8ed8c2-ab3e-4a60-bf7c-cfb7f1d66fc7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.002515] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('be8ed8c2-ab3e-4a60-bf7c-cfb7f1d66fc7',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.335828] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b2edef2f-e92d-4702-99d0-f3c32b9c1137 with status ACTIVE [ 657.336084] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.336225] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.336294] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.336542] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.336634] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.336812] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.336913] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.336971] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.337196] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.337290] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.337476] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.337569] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.337629] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.337770] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.337851] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.338033] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b2edef2f-e92d-4702-99d0-f3c32b9c1137 is going to be updated. [ 657.360533] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.360700] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.360848] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.361092] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.361156] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.361314] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b2edef2f-e92d-4702-99d0-f3c32b9c1137" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.504438] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port be8ed8c2-ab3e-4a60-bf7c-cfb7f1d66fc7 [ 657.504716] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.504896] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.504896] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.505135] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.505241] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.505323] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:be8ed8c2-ab3e-4a60-bf7c-cfb7f1d66fc7 already deleted. [ 657.505406] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-be8ed8c2-ab3e-4a60-bf7c-cfb7f1d66fc7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.839934] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e889ce7-965a-4de0-b096-60d4e743cf8b in Status: SUCCESS [ 657.840338] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.840562] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.840770] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.840992] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.841570] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.841763] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.841951] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.842084] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.842305] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.842626] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9e889ce7-965a-4de0-b096-60d4e743cf8b',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.844290] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a4c4fbaa-f4c9-4326-babb-bda6619acdf6 in Status: SUCCESS [ 657.844512] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a4c4fbaa-f4c9-4326-babb-bda6619acdf6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.844701] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.844950] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.845193] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.845292] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.845335] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.845489] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.845571] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.845660] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e889ce7-965a-4de0-b096-60d4e743cf8b',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.003353] env[65337]: INFO networking_nsxv3.common.synchronization [req-818c180d-2f1e-452b-963a-da0c0d32718f req-22bc53bb-59b9-4f6c-b74a-614c89ca7b43 tempest-ServersNegativeTestJSON-62579270 tempest-ServersNegativeTestJSON-62579270-project-member] Enqueued Resource ID: b2e84376-5c9f-45e7-9949-59bf17a96c95 with Priority: HIGHEST for action security_group_members [ 658.004064] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2e84376-5c9f-45e7-9949-59bf17a96c95 with Priority: HIGHEST for action security_group_members [ 658.004368] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-b2e84376-5c9f-45e7-9949-59bf17a96c95 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.004489] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b2e84376-5c9f-45e7-9949-59bf17a96c95" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.004551] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b2e84376-5c9f-45e7-9949-59bf17a96c95" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.004748] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b2e84376-5c9f-45e7-9949-59bf17a96c95" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.004899] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.004995] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.005068] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.005209] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.005292] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.005385] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b2e84376-5c9f-45e7-9949-59bf17a96c95',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.350330] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e889ce7-965a-4de0-b096-60d4e743cf8b taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.350475] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.354057] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9e889ce7-965a-4de0-b096-60d4e743cf8b',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.507502] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b2e84376-5c9f-45e7-9949-59bf17a96c95',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.562327] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock network-395 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.562598] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "network-395" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.563879] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "network-395" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.564568] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "network-395" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.564696] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.564846] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.565425] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.565425] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.565705] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.565780] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 658.566526] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 658.566526] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 658.566526] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 658.566526] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 658.566526] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 658.566526] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 658.602235] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 658.602435] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Cache value generated in 0.036 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 658.602568] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 658.602745] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "network-395" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.603238] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock port-39a1a380-da9c-4873-9371-141faef86e81 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.603474] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "port-39a1a380-da9c-4873-9371-141faef86e81" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.604033] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "port-39a1a380-da9c-4873-9371-141faef86e81" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.608325] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "port-39a1a380-da9c-4873-9371-141faef86e81" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.608544] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('39a1a380-da9c-4873-9371-141faef86e81',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.857409] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9e889ce7-965a-4de0-b096-60d4e743cf8b',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.010292] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b2e84376-5c9f-45e7-9949-59bf17a96c95',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.111060] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.111060] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.111289] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.111663] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.111889] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.112091] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Segment Port 39a1a380-da9c-4873-9371-141faef86e81 not found, creating... [ 659.112368] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.112532] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.112642] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.112930] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.113043] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.113348] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.113562] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.113629] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.114030] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.114217] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.114295] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Resource: SegmentPort with ID: 39a1a380-da9c-4873-9371-141faef86e81 is going to be created. [ 659.137707] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.138142] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.138273] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.138523] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.138779] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.139133] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "port-39a1a380-da9c-4873-9371-141faef86e81" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.360522] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.360806] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.361174] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.361481] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.361613] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.361752] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e889ce7-965a-4de0-b096-60d4e743cf8b is going to be updated. [ 659.398971] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.398971] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.399177] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.399561] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.399561] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.410740] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e889ce7-965a-4de0-b096-60d4e743cf8b in Status: IN_PROGRESS for 2s [ 659.505405] env[65337]: INFO networking_nsxv3.common.synchronization [None req-b35a3561-dd51-4874-bfa3-af4292a5feec None None] Enqueued Resource ID: b356fc90-a89b-43fc-b354-616991b49f24 with Priority: HIGHEST for action port [ 659.505906] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b356fc90-a89b-43fc-b354-616991b49f24 with Priority: HIGHEST for action port [ 659.506263] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-b356fc90-a89b-43fc-b354-616991b49f24 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.506376] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b356fc90-a89b-43fc-b354-616991b49f24" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.506513] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b356fc90-a89b-43fc-b354-616991b49f24" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.506689] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b356fc90-a89b-43fc-b354-616991b49f24" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.506781] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b356fc90-a89b-43fc-b354-616991b49f24',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.513047] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.513432] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.513432] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.513600] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.513682] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.513805] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b2e84376-5c9f-45e7-9949-59bf17a96c95 is going to be updated. [ 659.545641] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.545641] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.545641] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.545641] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.545961] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.555237] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b2e84376-5c9f-45e7-9949-59bf17a96c95 in Status: IN_PROGRESS for 2s [ 659.932290] env[65337]: INFO networking_nsxv3.common.synchronization [req-818c180d-2f1e-452b-963a-da0c0d32718f req-cb95c55e-0cfb-4765-9ace-3501b4872ed1 service nova] Enqueued Resource ID: b2e84376-5c9f-45e7-9949-59bf17a96c95 with Priority: HIGHEST for action security_group_rules [ 659.932290] env[65337]: INFO networking_nsxv3.common.synchronization [req-818c180d-2f1e-452b-963a-da0c0d32718f req-cb95c55e-0cfb-4765-9ace-3501b4872ed1 service nova] Enqueued Resource ID: b2e84376-5c9f-45e7-9949-59bf17a96c95 with Priority: HIGHEST for action security_group_members [ 659.932290] env[65337]: INFO networking_nsxv3.common.synchronization [req-818c180d-2f1e-452b-963a-da0c0d32718f req-cb95c55e-0cfb-4765-9ace-3501b4872ed1 service nova] Enqueued Resource ID: 39a1a380-da9c-4873-9371-141faef86e81 with Priority: HIGHEST for action port [ 659.932770] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2e84376-5c9f-45e7-9949-59bf17a96c95 with Priority: HIGHEST for action security_group_rules [ 659.932770] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2e84376-5c9f-45e7-9949-59bf17a96c95 with Priority: HIGHEST for action security_group_members [ 659.932770] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39a1a380-da9c-4873-9371-141faef86e81 with Priority: HIGHEST for action port [ 659.933205] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b2e84376-5c9f-45e7-9949-59bf17a96c95 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.933359] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b2e84376-5c9f-45e7-9949-59bf17a96c95" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.933429] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b2e84376-5c9f-45e7-9949-59bf17a96c95" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.933636] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b2e84376-5c9f-45e7-9949-59bf17a96c95" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.933766] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b2e84376-5c9f-45e7-9949-59bf17a96c95',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.934721] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-b2e84376-5c9f-45e7-9949-59bf17a96c95 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.934881] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b2e84376-5c9f-45e7-9949-59bf17a96c95" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.935068] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-39a1a380-da9c-4873-9371-141faef86e81 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.935192] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-39a1a380-da9c-4873-9371-141faef86e81" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.935265] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-39a1a380-da9c-4873-9371-141faef86e81" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.935518] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-39a1a380-da9c-4873-9371-141faef86e81" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.935518] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('39a1a380-da9c-4873-9371-141faef86e81',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.009478] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b356fc90-a89b-43fc-b354-616991b49f24 [ 660.009478] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.009478] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.009741] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.009741] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.009818] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.009888] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b356fc90-a89b-43fc-b354-616991b49f24 already deleted. [ 660.009970] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b356fc90-a89b-43fc-b354-616991b49f24" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.437482] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-b2e84376-5c9f-45e7-9949-59bf17a96c95 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.437654] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b2e84376-5c9f-45e7-9949-59bf17a96c95" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.437843] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 39a1a380-da9c-4873-9371-141faef86e81 with status ACTIVE [ 660.438030] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.438132] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.438272] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.438396] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.438480] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.438641] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.438738] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.438806] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.439057] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.439160] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.439343] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.439432] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.439513] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.439632] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.439695] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.440767] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 39a1a380-da9c-4873-9371-141faef86e81 is going to be updated. [ 660.474506] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.474732] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.475891] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.475891] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.475891] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.475891] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-39a1a380-da9c-4873-9371-141faef86e81" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.421868] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e889ce7-965a-4de0-b096-60d4e743cf8b in Status: SUCCESS [ 661.422941] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.423181] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.423448] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.423679] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.424213] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.424213] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.424213] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.424644] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.424784] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e889ce7-965a-4de0-b096-60d4e743cf8b',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.560155] env[65337]: INFO networking_nsxv3.common.synchronization [None req-69416077-0bc3-4f9a-adf1-c9b857c8c66f None None] Enqueued Resource ID: e17309fe-d614-416b-a730-17625a92a6de with Priority: HIGHEST for action port [ 661.561284] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e17309fe-d614-416b-a730-17625a92a6de with Priority: HIGHEST for action port [ 661.561668] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-e17309fe-d614-416b-a730-17625a92a6de taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.561841] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e17309fe-d614-416b-a730-17625a92a6de" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.561901] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e17309fe-d614-416b-a730-17625a92a6de" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.562240] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e17309fe-d614-416b-a730-17625a92a6de" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.562240] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e17309fe-d614-416b-a730-17625a92a6de',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.566524] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b2e84376-5c9f-45e7-9949-59bf17a96c95 in Status: SUCCESS [ 661.567885] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b2e84376-5c9f-45e7-9949-59bf17a96c95" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.567885] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b2e84376-5c9f-45e7-9949-59bf17a96c95" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.567885] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b2e84376-5c9f-45e7-9949-59bf17a96c95" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.567885] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.567885] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.567885] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.568204] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.568204] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.568361] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b2e84376-5c9f-45e7-9949-59bf17a96c95',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.927519] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9e889ce7-965a-4de0-b096-60d4e743cf8b',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.065847] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e17309fe-d614-416b-a730-17625a92a6de [ 662.065847] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.065847] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.065847] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.065847] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.065847] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.065847] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e17309fe-d614-416b-a730-17625a92a6de already deleted. [ 662.065847] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e17309fe-d614-416b-a730-17625a92a6de" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.072406] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b2e84376-5c9f-45e7-9949-59bf17a96c95',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.431842] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9e889ce7-965a-4de0-b096-60d4e743cf8b',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.576884] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b2e84376-5c9f-45e7-9949-59bf17a96c95',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.934346] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.934514] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.934583] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.934842] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.934932] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.935055] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e889ce7-965a-4de0-b096-60d4e743cf8b is going to be updated. [ 662.968855] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.969155] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.969233] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.969445] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.969599] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.981126] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e889ce7-965a-4de0-b096-60d4e743cf8b in Status: IN_PROGRESS for 2s [ 663.080851] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.080851] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.080851] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.080851] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.080851] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.081137] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b2e84376-5c9f-45e7-9949-59bf17a96c95 is going to be updated. [ 663.109755] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.109914] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.109983] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.110209] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.110348] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.121101] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b2e84376-5c9f-45e7-9949-59bf17a96c95 in Status: IN_PROGRESS for 2s [ 664.253331] env[65337]: INFO networking_nsxv3.common.synchronization [req-3e7ddd99-9e44-4689-b793-0b8bbca26193 req-dcf576ca-bd2f-4227-9292-b48c93633d44 tempest-ImagesTestJSON-1531636912 tempest-ImagesTestJSON-1531636912-project-member] Enqueued Resource ID: 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 with Priority: HIGHEST for action security_group_members [ 664.254369] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 with Priority: HIGHEST for action security_group_members [ 664.255066] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.255398] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.255526] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.255802] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.257656] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.257847] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.257847] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.258029] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.258199] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.258338] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7db87dc2-69af-45f1-90c2-f8a4ec96c3b7',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.764262] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.764262] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.764262] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.764262] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.764262] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.764262] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.764262] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.764262] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.764262] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.764262] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.764262] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 is going to be updated. [ 664.794021] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.794021] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.794021] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.794021] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.794021] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.804052] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 in Status: IN_PROGRESS for 2s [ 664.978030] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock network-626 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.978030] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "network-626" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.978030] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "network-626" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.978374] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "network-626" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.978752] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.979074] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.979319] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.979770] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.980054] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.980366] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 664.981138] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 664.981138] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 664.981138] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 664.981138] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 664.981138] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 664.981138] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 664.998472] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e889ce7-965a-4de0-b096-60d4e743cf8b in Status: SUCCESS [ 664.998789] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.999347] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.999656] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.999950] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.000159] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.000243] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.000804] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.000804] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.000804] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.001178] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e889ce7-965a-4de0-b096-60d4e743cf8b taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.001402] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.001402] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.001581] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.001670] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.001790] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.001876] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.002082] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.002164] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.002276] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.002408] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9e889ce7-965a-4de0-b096-60d4e743cf8b',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.007306] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 665.007460] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 665.007749] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 665.007749] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "network-626" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.008151] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock port-32a948b6-a441-468f-a1c6-3b9bf8c73269 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.008338] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "port-32a948b6-a441-468f-a1c6-3b9bf8c73269" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.008479] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "port-32a948b6-a441-468f-a1c6-3b9bf8c73269" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.008921] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "port-32a948b6-a441-468f-a1c6-3b9bf8c73269" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.009027] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('32a948b6-a441-468f-a1c6-3b9bf8c73269',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.131250] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b2e84376-5c9f-45e7-9949-59bf17a96c95 in Status: SUCCESS [ 665.131483] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b2e84376-5c9f-45e7-9949-59bf17a96c95" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.131664] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b2e84376-5c9f-45e7-9949-59bf17a96c95" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.131947] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b2e84376-5c9f-45e7-9949-59bf17a96c95" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.132179] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.132328] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.132398] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.132561] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.132642] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.132730] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b2e84376-5c9f-45e7-9949-59bf17a96c95" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.132823] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b2e84376-5c9f-45e7-9949-59bf17a96c95',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.202585] env[65337]: INFO networking_nsxv3.common.synchronization [None req-c88b8daa-7b33-497b-a5e9-3a6da26f4768 None None] Enqueued Resource ID: f64f90c9-d906-42a5-a8e0-012603f17f6e with Priority: HIGHEST for action port [ 665.203271] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f64f90c9-d906-42a5-a8e0-012603f17f6e with Priority: HIGHEST for action port [ 665.203591] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-f64f90c9-d906-42a5-a8e0-012603f17f6e taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.203870] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f64f90c9-d906-42a5-a8e0-012603f17f6e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.203870] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f64f90c9-d906-42a5-a8e0-012603f17f6e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.204116] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f64f90c9-d906-42a5-a8e0-012603f17f6e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.204198] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f64f90c9-d906-42a5-a8e0-012603f17f6e',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.259196] env[65337]: INFO networking_nsxv3.common.synchronization [None req-a697ccb4-d3aa-4305-a68a-f65b06b3fe68 None None] Enqueued Resource ID: 1b692e2d-7d22-4ac3-93b8-f0dd11ddc393 with Priority: HIGHEST for action port [ 665.259688] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b692e2d-7d22-4ac3-93b8-f0dd11ddc393 with Priority: HIGHEST for action port [ 665.260010] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-1b692e2d-7d22-4ac3-93b8-f0dd11ddc393 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.260145] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1b692e2d-7d22-4ac3-93b8-f0dd11ddc393" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.260212] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1b692e2d-7d22-4ac3-93b8-f0dd11ddc393" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.260462] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1b692e2d-7d22-4ac3-93b8-f0dd11ddc393" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.260548] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1b692e2d-7d22-4ac3-93b8-f0dd11ddc393',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.505033] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9e889ce7-965a-4de0-b096-60d4e743cf8b: rpc.has_security_group_logging(os_id): False [ 665.512244] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.512452] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.512591] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.512853] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.512999] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.513164] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Segment Port 32a948b6-a441-468f-a1c6-3b9bf8c73269 not found, creating... [ 665.513437] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.513596] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.513705] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.513975] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.514123] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.514431] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.514585] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.514697] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.514905] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.515066] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.515209] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Resource: SegmentPort with ID: 32a948b6-a441-468f-a1c6-3b9bf8c73269 is going to be created. [ 665.545874] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.546174] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.546260] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.546421] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.546518] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.546721] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.546825] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.546895] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.547046] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.547132] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.547341] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.547433] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.547491] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.547632] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.547705] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.547897] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.547992] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.548072] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.548199] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.548274] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.548412] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9e889ce7-965a-4de0-b096-60d4e743cf8b is going to be created. [ 665.552361] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.552590] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.552712] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.552920] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.553161] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.556577] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "port-32a948b6-a441-468f-a1c6-3b9bf8c73269" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.639581] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-b2e84376-5c9f-45e7-9949-59bf17a96c95 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.639581] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b2e84376-5c9f-45e7-9949-59bf17a96c95" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.639581] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b2e84376-5c9f-45e7-9949-59bf17a96c95" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.639581] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b2e84376-5c9f-45e7-9949-59bf17a96c95" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.639581] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.639581] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.639581] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.639581] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.639581] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.639581] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b2e84376-5c9f-45e7-9949-59bf17a96c95" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.639581] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-b2e84376-5c9f-45e7-9949-59bf17a96c95 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.639581] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b2e84376-5c9f-45e7-9949-59bf17a96c95" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.639581] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b2e84376-5c9f-45e7-9949-59bf17a96c95" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.639581] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b2e84376-5c9f-45e7-9949-59bf17a96c95" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.639581] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.640329] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.640329] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.640329] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.640329] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.640329] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b2e84376-5c9f-45e7-9949-59bf17a96c95" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.640329] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b2e84376-5c9f-45e7-9949-59bf17a96c95',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.679282] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.679507] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.679507] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.679691] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.679876] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.702293] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9e889ce7-965a-4de0-b096-60d4e743cf8b in Status: IN_PROGRESS for 2s [ 665.706562] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f64f90c9-d906-42a5-a8e0-012603f17f6e [ 665.706562] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.706562] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.706562] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.708522] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.708738] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.708738] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f64f90c9-d906-42a5-a8e0-012603f17f6e already deleted. [ 665.708818] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f64f90c9-d906-42a5-a8e0-012603f17f6e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.763224] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1b692e2d-7d22-4ac3-93b8-f0dd11ddc393 [ 665.763515] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.763620] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.763725] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.764009] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.764111] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.764212] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1b692e2d-7d22-4ac3-93b8-f0dd11ddc393 already deleted. [ 665.764296] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1b692e2d-7d22-4ac3-93b8-f0dd11ddc393" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.143204] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b2e84376-5c9f-45e7-9949-59bf17a96c95: rpc.has_security_group_logging(os_id): False [ 666.168044] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.168044] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.168044] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.168044] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.168044] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.168563] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.168563] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.168563] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.168811] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.168811] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.171445] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.171445] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.171445] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.171445] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.171445] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.171445] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.171445] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.171445] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.171445] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.171445] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.171445] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b2e84376-5c9f-45e7-9949-59bf17a96c95 is going to be updated. [ 666.267125] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.267593] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.267593] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.268217] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.268217] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.289682] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b2e84376-5c9f-45e7-9949-59bf17a96c95 in Status: IN_PROGRESS for 2s [ 666.332719] env[65337]: INFO networking_nsxv3.common.synchronization [req-3e7ddd99-9e44-4689-b793-0b8bbca26193 req-9c063fb4-644e-40b5-b2a0-98ae13f251a6 service nova] Enqueued Resource ID: 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 with Priority: HIGHEST for action security_group_rules [ 666.332932] env[65337]: INFO networking_nsxv3.common.synchronization [req-3e7ddd99-9e44-4689-b793-0b8bbca26193 req-9c063fb4-644e-40b5-b2a0-98ae13f251a6 service nova] Enqueued Resource ID: 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 with Priority: HIGHEST for action security_group_members [ 666.333099] env[65337]: INFO networking_nsxv3.common.synchronization [req-3e7ddd99-9e44-4689-b793-0b8bbca26193 req-9c063fb4-644e-40b5-b2a0-98ae13f251a6 service nova] Enqueued Resource ID: 32a948b6-a441-468f-a1c6-3b9bf8c73269 with Priority: HIGHEST for action port [ 666.333651] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 with Priority: HIGHEST for action security_group_rules [ 666.333819] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 with Priority: HIGHEST for action security_group_members [ 666.333922] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32a948b6-a441-468f-a1c6-3b9bf8c73269 with Priority: HIGHEST for action port [ 666.334981] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.334981] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.335148] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.335326] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.335366] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7db87dc2-69af-45f1-90c2-f8a4ec96c3b7',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.338963] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.338963] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.338963] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-32a948b6-a441-468f-a1c6-3b9bf8c73269 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.338963] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-32a948b6-a441-468f-a1c6-3b9bf8c73269" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.338963] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-32a948b6-a441-468f-a1c6-3b9bf8c73269" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.338963] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-32a948b6-a441-468f-a1c6-3b9bf8c73269" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.338963] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('32a948b6-a441-468f-a1c6-3b9bf8c73269',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.681433] env[65337]: INFO networking_nsxv3.common.synchronization [None req-93fe176b-15eb-49a5-ad2f-1ec41147de05 None None] Enqueued Resource ID: 1012884b-a25c-468b-b3e8-d0928d23ae36 with Priority: HIGHEST for action port [ 666.681970] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1012884b-a25c-468b-b3e8-d0928d23ae36 with Priority: HIGHEST for action port [ 666.683983] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-1012884b-a25c-468b-b3e8-d0928d23ae36 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.683983] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1012884b-a25c-468b-b3e8-d0928d23ae36" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.683983] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1012884b-a25c-468b-b3e8-d0928d23ae36" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.684376] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1012884b-a25c-468b-b3e8-d0928d23ae36" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.684376] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1012884b-a25c-468b-b3e8-d0928d23ae36',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.844837] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.844982] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.845176] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 32a948b6-a441-468f-a1c6-3b9bf8c73269 with status ACTIVE [ 666.845342] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.845445] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.845504] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.845696] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.845778] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.845942] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.846044] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.846104] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.850445] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.850445] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.850445] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.850445] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.850445] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.850445] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.850445] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.850445] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 32a948b6-a441-468f-a1c6-3b9bf8c73269 is going to be updated. [ 666.857876] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 in Status: SUCCESS [ 666.858093] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 deletion is rescheduled due to dependency. [ 666.858218] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.858940] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.859406] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.859620] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.859747] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.860486] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.860486] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.860486] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.860486] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7db87dc2-69af-45f1-90c2-f8a4ec96c3b7',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.872972] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.873167] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.873167] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.873437] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.874028] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.874028] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-32a948b6-a441-468f-a1c6-3b9bf8c73269" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.255846] env[65337]: INFO networking_nsxv3.common.synchronization [None req-2df9b479-e7b4-43be-9ba7-25cee808cc65 None None] Enqueued Resource ID: d0a17e61-ecba-4004-a7c4-1dfe8876243d with Priority: HIGHEST for action port [ 667.256487] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0a17e61-ecba-4004-a7c4-1dfe8876243d with Priority: HIGHEST for action port [ 667.256830] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-d0a17e61-ecba-4004-a7c4-1dfe8876243d taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.256966] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d0a17e61-ecba-4004-a7c4-1dfe8876243d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.257552] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d0a17e61-ecba-4004-a7c4-1dfe8876243d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.257977] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d0a17e61-ecba-4004-a7c4-1dfe8876243d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.258148] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d0a17e61-ecba-4004-a7c4-1dfe8876243d',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.348751] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1012884b-a25c-468b-b3e8-d0928d23ae36 [ 667.349192] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.349192] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.349192] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.349422] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.349515] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.349631] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1012884b-a25c-468b-b3e8-d0928d23ae36 already deleted. [ 667.349719] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1012884b-a25c-468b-b3e8-d0928d23ae36" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.363262] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7db87dc2-69af-45f1-90c2-f8a4ec96c3b7',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.716025] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9e889ce7-965a-4de0-b096-60d4e743cf8b in Status: SUCCESS [ 667.716025] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.716255] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.716490] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.716581] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9e889ce7-965a-4de0-b096-60d4e743cf8b',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.763170] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d0a17e61-ecba-4004-a7c4-1dfe8876243d [ 667.763170] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.763170] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.763170] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.763170] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.763170] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.763170] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d0a17e61-ecba-4004-a7c4-1dfe8876243d already deleted. [ 667.763170] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d0a17e61-ecba-4004-a7c4-1dfe8876243d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.865591] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7db87dc2-69af-45f1-90c2-f8a4ec96c3b7',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.219798] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e889ce7-965a-4de0-b096-60d4e743cf8b taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.219957] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.220055] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.220261] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.220426] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.220527] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.220598] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.220721] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.220874] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.220974] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.221087] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9e889ce7-965a-4de0-b096-60d4e743cf8b',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.305607] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b2e84376-5c9f-45e7-9949-59bf17a96c95 in Status: SUCCESS [ 668.305971] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b2e84376-5c9f-45e7-9949-59bf17a96c95" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.369174] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.369174] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.369174] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.370100] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.370100] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.371661] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 is going to be updated. [ 668.401462] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.401614] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.401713] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.402066] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.402066] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.413082] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 in Status: IN_PROGRESS for 2s [ 668.725829] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e889ce7-965a-4de0-b096-60d4e743cf8b taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.726805] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.726805] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.726805] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.726989] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.727054] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.727096] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.727247] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.728429] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.728595] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.728773] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e889ce7-965a-4de0-b096-60d4e743cf8b taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.728880] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.728948] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.731334] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.731445] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.731567] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.731634] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.733728] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.733728] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.733728] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.733728] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9e889ce7-965a-4de0-b096-60d4e743cf8b',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.235399] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9e889ce7-965a-4de0-b096-60d4e743cf8b: rpc.has_security_group_logging(os_id): False [ 669.257276] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.257498] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.257498] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.258024] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.258024] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.258024] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.258313] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.258313] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.258424] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.258480] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.259928] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.259928] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.259928] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.259928] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.260170] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.260386] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.260490] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.260552] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.260696] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.260845] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.260888] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9e889ce7-965a-4de0-b096-60d4e743cf8b is going to be updated. [ 669.348033] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.348356] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.348421] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.348719] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.348973] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.360387] env[65337]: INFO networking_nsxv3.common.synchronization [None req-d9bddffd-5b89-465f-90fd-042a94a93385 None None] Enqueued Resource ID: a73ffd9a-0bca-4e24-97d6-602da43d1fc3 with Priority: HIGHEST for action port [ 669.361213] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a73ffd9a-0bca-4e24-97d6-602da43d1fc3 with Priority: HIGHEST for action port [ 669.362937] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-a73ffd9a-0bca-4e24-97d6-602da43d1fc3 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.363514] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a73ffd9a-0bca-4e24-97d6-602da43d1fc3" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.363514] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a73ffd9a-0bca-4e24-97d6-602da43d1fc3" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.364693] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a73ffd9a-0bca-4e24-97d6-602da43d1fc3" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.365091] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a73ffd9a-0bca-4e24-97d6-602da43d1fc3',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.373359] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9e889ce7-965a-4de0-b096-60d4e743cf8b in Status: IN_PROGRESS for 2s [ 669.868111] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a73ffd9a-0bca-4e24-97d6-602da43d1fc3 [ 669.868372] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.868518] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.868581] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.868811] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.868906] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.869012] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a73ffd9a-0bca-4e24-97d6-602da43d1fc3 already deleted. [ 669.869102] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a73ffd9a-0bca-4e24-97d6-602da43d1fc3" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.928343] env[65337]: INFO networking_nsxv3.common.synchronization [req-e2d6ec1c-95aa-48a1-b2b5-d920db38cd8e req-85e39c81-6234-4b9c-8f60-a5e382763d3e tempest-SecurityGroupRulesTestJSON-1213382043 tempest-SecurityGroupRulesTestJSON-1213382043-project-member] Enqueued Resource ID: e17d771b-d553-4433-94af-121efb9afa45 with Priority: HIGHEST for action security_group_rules [ 669.929023] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e17d771b-d553-4433-94af-121efb9afa45 with Priority: HIGHEST for action security_group_rules [ 669.933671] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e17d771b-d553-4433-94af-121efb9afa45 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.933837] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e17d771b-d553-4433-94af-121efb9afa45" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.933837] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e17d771b-d553-4433-94af-121efb9afa45" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.935036] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e17d771b-d553-4433-94af-121efb9afa45" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.935036] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e17d771b-d553-4433-94af-121efb9afa45',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.089142] env[65337]: INFO networking_nsxv3.common.synchronization [None req-26a9b27e-41ab-4cea-afbe-b8568488a4e4 tempest-ServerActionsTestOtherA-84911055 tempest-ServerActionsTestOtherA-84911055-project-member] Enqueued Resource ID: a4a9546d-8cbc-404d-acef-d7856f353fbe with Priority: HIGHEST for action security_group_rules [ 670.089938] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4a9546d-8cbc-404d-acef-d7856f353fbe with Priority: HIGHEST for action security_group_rules [ 670.090159] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a4a9546d-8cbc-404d-acef-d7856f353fbe taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.090325] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a4a9546d-8cbc-404d-acef-d7856f353fbe" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.090411] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a4a9546d-8cbc-404d-acef-d7856f353fbe" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.091840] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a4a9546d-8cbc-404d-acef-d7856f353fbe" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.091840] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a4a9546d-8cbc-404d-acef-d7856f353fbe',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.252825] env[65337]: INFO networking_nsxv3.common.synchronization [None req-5d57870e-bec7-4edc-b874-087e29acab86 tempest-ServerActionsTestOtherA-84911055 tempest-ServerActionsTestOtherA-84911055-project-member] Enqueued Resource ID: a4a9546d-8cbc-404d-acef-d7856f353fbe with Priority: HIGHEST for action security_group_rules [ 670.254379] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4a9546d-8cbc-404d-acef-d7856f353fbe with Priority: HIGHEST for action security_group_rules [ 670.256615] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a4a9546d-8cbc-404d-acef-d7856f353fbe taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.256615] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a4a9546d-8cbc-404d-acef-d7856f353fbe" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.425075] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 in Status: SUCCESS [ 670.426033] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.426033] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.426033] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.426033] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.426033] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.426033] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.427825] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.427944] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.428056] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.428162] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7db87dc2-69af-45f1-90c2-f8a4ec96c3b7',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.467916] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.468421] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.468549] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.469045] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.469045] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.469045] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e17d771b-d553-4433-94af-121efb9afa45 already deleted. [ 670.469045] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e17d771b-d553-4433-94af-121efb9afa45" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.613647] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.613647] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.613647] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.613647] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.613647] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.613647] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a4a9546d-8cbc-404d-acef-d7856f353fbe already deleted. [ 670.613647] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a4a9546d-8cbc-404d-acef-d7856f353fbe" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.613647] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a4a9546d-8cbc-404d-acef-d7856f353fbe" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.613647] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a4a9546d-8cbc-404d-acef-d7856f353fbe" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.615106] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a4a9546d-8cbc-404d-acef-d7856f353fbe',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.790303] env[65337]: INFO networking_nsxv3.common.synchronization [None req-d67e3cf4-a9f2-40ca-968e-bfa7f4adedf8 None None] Enqueued Resource ID: 0ad8cbc5-cff9-475f-b5ce-b5216c77908e with Priority: HIGHEST for action port [ 670.790850] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ad8cbc5-cff9-475f-b5ce-b5216c77908e with Priority: HIGHEST for action port [ 670.791366] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-0ad8cbc5-cff9-475f-b5ce-b5216c77908e taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.791366] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0ad8cbc5-cff9-475f-b5ce-b5216c77908e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.791366] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0ad8cbc5-cff9-475f-b5ce-b5216c77908e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.791616] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0ad8cbc5-cff9-475f-b5ce-b5216c77908e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.791710] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0ad8cbc5-cff9-475f-b5ce-b5216c77908e',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.932236] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.932236] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.932236] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.932663] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.932663] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.932852] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.932852] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.933117] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.933117] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.933221] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.933316] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.933473] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.933473] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.933596] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.933794] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.933901] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.933952] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.934082] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.934153] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.934233] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.934320] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7db87dc2-69af-45f1-90c2-f8a4ec96c3b7',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.139255] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.139255] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.139525] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.139525] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.139643] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.139713] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a4a9546d-8cbc-404d-acef-d7856f353fbe already deleted. [ 671.139770] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a4a9546d-8cbc-404d-acef-d7856f353fbe" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.221898] env[65337]: INFO networking_nsxv3.common.synchronization [None req-ef04d7b1-f312-4b06-a4f1-55073e47df0c tempest-AttachInterfacesTestJSON-1783062477 tempest-AttachInterfacesTestJSON-1783062477-project-member] Enqueued Resource ID: ee03c436-a01f-49f3-9012-42ca1b72c1d4 with Priority: HIGHEST for action security_group_rules [ 671.221898] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee03c436-a01f-49f3-9012-42ca1b72c1d4 with Priority: HIGHEST for action security_group_rules [ 671.222524] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ee03c436-a01f-49f3-9012-42ca1b72c1d4 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.222611] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ee03c436-a01f-49f3-9012-42ca1b72c1d4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.222677] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ee03c436-a01f-49f3-9012-42ca1b72c1d4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.223529] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ee03c436-a01f-49f3-9012-42ca1b72c1d4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.223529] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ee03c436-a01f-49f3-9012-42ca1b72c1d4',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.298268] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0ad8cbc5-cff9-475f-b5ce-b5216c77908e [ 671.298603] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.298680] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.298929] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.299292] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.299984] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.300380] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0ad8cbc5-cff9-475f-b5ce-b5216c77908e already deleted. [ 671.300380] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0ad8cbc5-cff9-475f-b5ce-b5216c77908e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.390089] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9e889ce7-965a-4de0-b096-60d4e743cf8b in Status: SUCCESS [ 671.390969] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.437340] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7: rpc.has_security_group_logging(os_id): False [ 671.449450] env[65337]: INFO networking_nsxv3.common.synchronization [None req-e02ed353-9b1d-42a9-8d2d-4abdc34d123f tempest-AttachInterfacesTestJSON-1783062477 tempest-AttachInterfacesTestJSON-1783062477-project-member] Enqueued Resource ID: ee03c436-a01f-49f3-9012-42ca1b72c1d4 with Priority: HIGHEST for action security_group_rules [ 671.450164] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee03c436-a01f-49f3-9012-42ca1b72c1d4 with Priority: HIGHEST for action security_group_rules [ 671.450862] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ee03c436-a01f-49f3-9012-42ca1b72c1d4 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.450978] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ee03c436-a01f-49f3-9012-42ca1b72c1d4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.462661] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.462661] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.462661] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.462894] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.463022] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.463188] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.463294] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.463355] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.463515] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.463565] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.463734] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.463869] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.463932] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.464051] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.464127] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.464302] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.464395] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.464454] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.464590] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.464662] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.464796] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 is going to be updated. [ 671.469251] env[65337]: INFO networking_nsxv3.common.synchronization [req-a5dddccd-4c5e-4bf0-bc67-e32b838c6537 req-7e054650-f998-4cf2-9a18-adf1315ccdb3 tempest-InstanceActionsTestJSON-1203928558 tempest-InstanceActionsTestJSON-1203928558-project-member] Enqueued Resource ID: aacfa5f1-5795-4724-a0b1-919591e92f80 with Priority: HIGHEST for action security_group_members [ 671.469843] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aacfa5f1-5795-4724-a0b1-919591e92f80 with Priority: HIGHEST for action security_group_members [ 671.470401] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-aacfa5f1-5795-4724-a0b1-919591e92f80 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.470542] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aacfa5f1-5795-4724-a0b1-919591e92f80" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.470617] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aacfa5f1-5795-4724-a0b1-919591e92f80" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.470749] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aacfa5f1-5795-4724-a0b1-919591e92f80" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.473239] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.473239] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.473239] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.473239] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.473239] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.473239] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aacfa5f1-5795-4724-a0b1-919591e92f80',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.564192] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.564192] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.564192] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.564192] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.564499] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.580492] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 in Status: IN_PROGRESS for 2s [ 671.751500] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.751713] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.751858] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.752159] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.752224] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.752350] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ee03c436-a01f-49f3-9012-42ca1b72c1d4 already deleted. [ 671.752480] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ee03c436-a01f-49f3-9012-42ca1b72c1d4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.752661] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ee03c436-a01f-49f3-9012-42ca1b72c1d4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.752824] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ee03c436-a01f-49f3-9012-42ca1b72c1d4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.752955] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ee03c436-a01f-49f3-9012-42ca1b72c1d4',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.975373] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.975518] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.975604] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.975881] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.975986] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.976220] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.977100] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.977100] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.977100] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.977100] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.977404] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aacfa5f1-5795-4724-a0b1-919591e92f80 is going to be updated. [ 672.016987] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.016987] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.016987] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.017223] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.017405] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.035162] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aacfa5f1-5795-4724-a0b1-919591e92f80 in Status: IN_PROGRESS for 2s [ 672.276102] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.276314] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.276400] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.276644] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.276741] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.276845] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ee03c436-a01f-49f3-9012-42ca1b72c1d4 already deleted. [ 672.276934] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ee03c436-a01f-49f3-9012-42ca1b72c1d4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.399136] env[65337]: INFO networking_nsxv3.common.synchronization [req-80b91212-444d-4cf3-819d-1fbc2f2bed5e req-bec4db72-c255-4143-8c6f-f9d4ea8c67ff tempest-VolumesAdminNegativeTest-935490652 tempest-VolumesAdminNegativeTest-935490652-project-member] Enqueued Resource ID: 13c1490a-eab4-4d63-8d39-9071228c67fc with Priority: HIGHEST for action security_group_members [ 672.400170] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13c1490a-eab4-4d63-8d39-9071228c67fc with Priority: HIGHEST for action security_group_members [ 672.400347] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-13c1490a-eab4-4d63-8d39-9071228c67fc taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.400500] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-13c1490a-eab4-4d63-8d39-9071228c67fc" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.400567] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-13c1490a-eab4-4d63-8d39-9071228c67fc" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.400759] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-13c1490a-eab4-4d63-8d39-9071228c67fc" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.400923] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.401030] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.401091] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.401233] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.403206] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.403206] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('13c1490a-eab4-4d63-8d39-9071228c67fc',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.481259] env[65337]: INFO networking_nsxv3.common.synchronization [None req-e5793989-732e-48f5-b10e-7ec92c80fc6c tempest-MigrationsAdminTest-367558634 tempest-MigrationsAdminTest-367558634-project-member] Enqueued Resource ID: 06235277-f1e6-4070-b7a5-6a6f5097fe9b with Priority: HIGHEST for action security_group_rules [ 672.481259] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06235277-f1e6-4070-b7a5-6a6f5097fe9b with Priority: HIGHEST for action security_group_rules [ 672.481259] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06235277-f1e6-4070-b7a5-6a6f5097fe9b taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.481259] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06235277-f1e6-4070-b7a5-6a6f5097fe9b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.481259] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06235277-f1e6-4070-b7a5-6a6f5097fe9b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.483187] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06235277-f1e6-4070-b7a5-6a6f5097fe9b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.483305] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06235277-f1e6-4070-b7a5-6a6f5097fe9b',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.507144] env[65337]: INFO networking_nsxv3.common.synchronization [req-301bf2e3-e4c0-4ed4-b63a-261edc42bb02 req-353c1487-6fe7-4a5f-abcf-dfa15912ac6d tempest-SecurityGroupRulesTestJSON-1213382043 tempest-SecurityGroupRulesTestJSON-1213382043-project-member] Enqueued Resource ID: e17d771b-d553-4433-94af-121efb9afa45 with Priority: HIGHEST for action security_group_rules [ 672.510973] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e17d771b-d553-4433-94af-121efb9afa45 with Priority: HIGHEST for action security_group_rules [ 672.512784] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e17d771b-d553-4433-94af-121efb9afa45 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.512936] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e17d771b-d553-4433-94af-121efb9afa45" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.512936] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e17d771b-d553-4433-94af-121efb9afa45" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.513987] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e17d771b-d553-4433-94af-121efb9afa45" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.513987] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e17d771b-d553-4433-94af-121efb9afa45',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.675636] env[65337]: INFO networking_nsxv3.common.synchronization [None req-41f676e8-f3fa-4898-93f4-2ba642bc8bcf tempest-MigrationsAdminTest-367558634 tempest-MigrationsAdminTest-367558634-project-member] Enqueued Resource ID: 06235277-f1e6-4070-b7a5-6a6f5097fe9b with Priority: HIGHEST for action security_group_rules [ 672.676825] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06235277-f1e6-4070-b7a5-6a6f5097fe9b with Priority: HIGHEST for action security_group_rules [ 672.677399] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06235277-f1e6-4070-b7a5-6a6f5097fe9b taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.677579] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06235277-f1e6-4070-b7a5-6a6f5097fe9b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.908406] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.909110] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.909110] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.909110] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.909110] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.909324] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.910031] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.910031] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.910031] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.910031] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.910031] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 13c1490a-eab4-4d63-8d39-9071228c67fc is going to be updated. [ 672.945438] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.945438] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.945438] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.945438] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.945438] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.955680] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 13c1490a-eab4-4d63-8d39-9071228c67fc in Status: IN_PROGRESS for 2s [ 673.019975] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.019975] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.019975] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.019975] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.020282] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.020282] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06235277-f1e6-4070-b7a5-6a6f5097fe9b already deleted. [ 673.020282] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06235277-f1e6-4070-b7a5-6a6f5097fe9b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.020390] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06235277-f1e6-4070-b7a5-6a6f5097fe9b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.020519] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06235277-f1e6-4070-b7a5-6a6f5097fe9b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.020579] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06235277-f1e6-4070-b7a5-6a6f5097fe9b',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.034764] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.035360] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.040926] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.040926] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.040926] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.040926] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e17d771b-d553-4433-94af-121efb9afa45 already deleted. [ 673.040926] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e17d771b-d553-4433-94af-121efb9afa45" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.548040] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.548391] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.548391] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.548491] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.548538] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.548627] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06235277-f1e6-4070-b7a5-6a6f5097fe9b already deleted. [ 673.550027] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06235277-f1e6-4070-b7a5-6a6f5097fe9b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.598703] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 in Status: SUCCESS [ 673.598932] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.998920] env[65337]: INFO networking_nsxv3.common.synchronization [req-412b0520-5a1b-48a5-9d61-258fd27f9638 req-780897f0-3834-438d-8f34-fe417ff7072c tempest-FloatingIPsAssociationTestJSON-1937565574 tempest-FloatingIPsAssociationTestJSON-1937565574-project-member] Enqueued Resource ID: 3cc33494-7b08-499a-b8bc-a9ae6b25d9d2 with Priority: HIGHEST for action security_group_members [ 673.999519] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cc33494-7b08-499a-b8bc-a9ae6b25d9d2 with Priority: HIGHEST for action security_group_members [ 673.999852] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-3cc33494-7b08-499a-b8bc-a9ae6b25d9d2 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.999982] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3cc33494-7b08-499a-b8bc-a9ae6b25d9d2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.000334] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3cc33494-7b08-499a-b8bc-a9ae6b25d9d2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.000718] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3cc33494-7b08-499a-b8bc-a9ae6b25d9d2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.000895] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.000995] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.001067] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.001238] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.001325] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.001421] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3cc33494-7b08-499a-b8bc-a9ae6b25d9d2',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.051795] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aacfa5f1-5795-4724-a0b1-919591e92f80 in Status: SUCCESS [ 674.052012] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aacfa5f1-5795-4724-a0b1-919591e92f80 deletion is rescheduled due to dependency. [ 674.052496] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aacfa5f1-5795-4724-a0b1-919591e92f80" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.414889] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock network-69 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.416362] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "network-69" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.416535] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "network-69" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.416932] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "network-69" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.417322] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.417500] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.417610] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.417843] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.417983] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.418277] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 674.418385] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 674.418487] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 674.418586] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 674.418687] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 674.418785] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 674.418909] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 674.442989] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 674.443290] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 674.443448] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 674.443643] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "network-69" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.444080] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock port-39756fa8-94ff-4942-937f-2121b1ec4073 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.444275] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "port-39756fa8-94ff-4942-937f-2121b1ec4073" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.444450] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "port-39756fa8-94ff-4942-937f-2121b1ec4073" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.444909] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "port-39756fa8-94ff-4942-937f-2121b1ec4073" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.445203] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('39756fa8-94ff-4942-937f-2121b1ec4073',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.503303] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.503416] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.503479] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.503875] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.503875] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.504070] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.504070] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.504223] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.504283] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.504356] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.504438] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3cc33494-7b08-499a-b8bc-a9ae6b25d9d2 already deleted. [ 674.504516] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3cc33494-7b08-499a-b8bc-a9ae6b25d9d2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.948772] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.949143] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.950408] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.950408] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.950408] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.950408] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Segment Port 39756fa8-94ff-4942-937f-2121b1ec4073 not found, creating... [ 674.952707] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.952707] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.952707] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.952707] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.952707] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.952707] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.953478] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.953478] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.953478] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.953478] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.953478] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Resource: SegmentPort with ID: 39756fa8-94ff-4942-937f-2121b1ec4073 is going to be created. [ 674.973044] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 13c1490a-eab4-4d63-8d39-9071228c67fc in Status: SUCCESS [ 674.973243] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 13c1490a-eab4-4d63-8d39-9071228c67fc deletion is rescheduled due to dependency. [ 674.973653] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-13c1490a-eab4-4d63-8d39-9071228c67fc" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.984843] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.984843] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.984843] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.984843] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.984843] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.984843] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "port-39756fa8-94ff-4942-937f-2121b1ec4073" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.059409] env[65337]: INFO networking_nsxv3.common.synchronization [None req-5bf5e140-672e-44dd-a76d-d415bc7fe072 None None] Enqueued Resource ID: 1f0b2ced-176b-4a2e-8a01-db9b190464cc with Priority: HIGHEST for action port [ 675.065397] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f0b2ced-176b-4a2e-8a01-db9b190464cc with Priority: HIGHEST for action port [ 675.065397] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-1f0b2ced-176b-4a2e-8a01-db9b190464cc taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.065397] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1f0b2ced-176b-4a2e-8a01-db9b190464cc" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.065397] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1f0b2ced-176b-4a2e-8a01-db9b190464cc" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.065397] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1f0b2ced-176b-4a2e-8a01-db9b190464cc" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.065397] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1f0b2ced-176b-4a2e-8a01-db9b190464cc',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.079588] env[65337]: INFO networking_nsxv3.common.synchronization [req-5b6dda04-d21d-4af3-bc07-69f55e44d6c2 req-c9eb4024-fabb-47bc-b286-ad98ac96da4e tempest-ServerAddressesTestJSON-2058622675 tempest-ServerAddressesTestJSON-2058622675-project-member] Enqueued Resource ID: 51b69fea-e790-4b59-8a34-41bdb9264f84 with Priority: HIGHEST for action security_group_members [ 675.079588] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51b69fea-e790-4b59-8a34-41bdb9264f84 with Priority: HIGHEST for action security_group_members [ 675.083563] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-51b69fea-e790-4b59-8a34-41bdb9264f84 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.083563] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-51b69fea-e790-4b59-8a34-41bdb9264f84" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.083563] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-51b69fea-e790-4b59-8a34-41bdb9264f84" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.083563] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-51b69fea-e790-4b59-8a34-41bdb9264f84" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.083563] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.083563] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.083563] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.083563] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.083563] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.083563] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('51b69fea-e790-4b59-8a34-41bdb9264f84',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.571558] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1f0b2ced-176b-4a2e-8a01-db9b190464cc [ 675.571558] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.571558] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.571558] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.571558] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.571558] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.571558] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1f0b2ced-176b-4a2e-8a01-db9b190464cc already deleted. [ 675.571558] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1f0b2ced-176b-4a2e-8a01-db9b190464cc" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.588278] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.588471] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.588552] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.588810] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.588964] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.589201] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.589295] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.589369] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.589519] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.589636] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.589757] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 51b69fea-e790-4b59-8a34-41bdb9264f84 is going to be updated. [ 675.625025] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.625225] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.625289] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.625451] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.625591] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.635956] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 51b69fea-e790-4b59-8a34-41bdb9264f84 in Status: IN_PROGRESS for 2s [ 675.761584] env[65337]: INFO networking_nsxv3.common.synchronization [req-412b0520-5a1b-48a5-9d61-258fd27f9638 req-8e215dcc-6b2e-466d-bbff-5968581d6345 service nova] Enqueued Resource ID: 3cc33494-7b08-499a-b8bc-a9ae6b25d9d2 with Priority: HIGHEST for action security_group_rules [ 675.761805] env[65337]: INFO networking_nsxv3.common.synchronization [req-412b0520-5a1b-48a5-9d61-258fd27f9638 req-8e215dcc-6b2e-466d-bbff-5968581d6345 service nova] Enqueued Resource ID: 3cc33494-7b08-499a-b8bc-a9ae6b25d9d2 with Priority: HIGHEST for action security_group_members [ 675.761898] env[65337]: INFO networking_nsxv3.common.synchronization [req-412b0520-5a1b-48a5-9d61-258fd27f9638 req-8e215dcc-6b2e-466d-bbff-5968581d6345 service nova] Enqueued Resource ID: 39756fa8-94ff-4942-937f-2121b1ec4073 with Priority: HIGHEST for action port [ 675.762535] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cc33494-7b08-499a-b8bc-a9ae6b25d9d2 with Priority: HIGHEST for action security_group_rules [ 675.762735] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cc33494-7b08-499a-b8bc-a9ae6b25d9d2 with Priority: HIGHEST for action security_group_members [ 675.762788] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39756fa8-94ff-4942-937f-2121b1ec4073 with Priority: HIGHEST for action port [ 675.763134] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3cc33494-7b08-499a-b8bc-a9ae6b25d9d2 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.763224] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3cc33494-7b08-499a-b8bc-a9ae6b25d9d2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.763266] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3cc33494-7b08-499a-b8bc-a9ae6b25d9d2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.763538] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3cc33494-7b08-499a-b8bc-a9ae6b25d9d2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.763589] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3cc33494-7b08-499a-b8bc-a9ae6b25d9d2',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.764542] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-3cc33494-7b08-499a-b8bc-a9ae6b25d9d2 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.764639] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3cc33494-7b08-499a-b8bc-a9ae6b25d9d2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.764707] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3cc33494-7b08-499a-b8bc-a9ae6b25d9d2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.764965] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3cc33494-7b08-499a-b8bc-a9ae6b25d9d2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.765087] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.765216] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.765263] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.765383] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.765469] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.765561] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3cc33494-7b08-499a-b8bc-a9ae6b25d9d2',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.766607] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-39756fa8-94ff-4942-937f-2121b1ec4073 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.766731] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-39756fa8-94ff-4942-937f-2121b1ec4073" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.766791] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-39756fa8-94ff-4942-937f-2121b1ec4073" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.766943] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-39756fa8-94ff-4942-937f-2121b1ec4073" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.767038] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('39756fa8-94ff-4942-937f-2121b1ec4073',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.192029] env[65337]: INFO networking_nsxv3.common.synchronization [req-47221337-a034-4500-8147-d68bd7b548a8 req-deb80422-80b9-43c7-9703-c65eeaf17cb9 tempest-DeleteServersAdminTestJSON-1195367916 tempest-DeleteServersAdminTestJSON-1195367916-project-member] Enqueued Resource ID: a4c4fbaa-f4c9-4326-babb-bda6619acdf6 with Priority: HIGHEST for action security_group_members [ 676.192829] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4c4fbaa-f4c9-4326-babb-bda6619acdf6 with Priority: HIGHEST for action security_group_members [ 676.195664] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4c4fbaa-f4c9-4326-babb-bda6619acdf6 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.195896] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4c4fbaa-f4c9-4326-babb-bda6619acdf6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.196012] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4c4fbaa-f4c9-4326-babb-bda6619acdf6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.196345] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4c4fbaa-f4c9-4326-babb-bda6619acdf6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.196618] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.196708] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.196819] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.197020] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.197148] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.197289] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a4c4fbaa-f4c9-4326-babb-bda6619acdf6',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.270473] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-3cc33494-7b08-499a-b8bc-a9ae6b25d9d2 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.270473] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3cc33494-7b08-499a-b8bc-a9ae6b25d9d2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.270473] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3cc33494-7b08-499a-b8bc-a9ae6b25d9d2',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.271507] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 39756fa8-94ff-4942-937f-2121b1ec4073 with status ACTIVE [ 676.276114] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.276114] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.276114] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.276114] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.276114] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.276114] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.276114] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.276114] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.276114] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.276114] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.276114] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.276114] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.276114] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.276114] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.276114] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.276114] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 39756fa8-94ff-4942-937f-2121b1ec4073 is going to be updated. [ 676.319322] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.319522] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.319522] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.319764] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.319920] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.320126] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-39756fa8-94ff-4942-937f-2121b1ec4073" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.403296] env[65337]: INFO networking_nsxv3.common.synchronization [req-467871f3-3a43-4600-91b6-e7b162426402 req-e525b7f6-d0e7-481f-a2fa-1d4a06e67355 tempest-AttachInterfacesUnderV243Test-1010804015 tempest-AttachInterfacesUnderV243Test-1010804015-project-member] Enqueued Resource ID: 5afc8a2a-3bb1-4c3e-a10b-0941514929b4 with Priority: HIGHEST for action security_group_members [ 676.404038] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5afc8a2a-3bb1-4c3e-a10b-0941514929b4 with Priority: HIGHEST for action security_group_members [ 676.404482] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-5afc8a2a-3bb1-4c3e-a10b-0941514929b4 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.404655] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5afc8a2a-3bb1-4c3e-a10b-0941514929b4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.404755] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5afc8a2a-3bb1-4c3e-a10b-0941514929b4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.404987] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5afc8a2a-3bb1-4c3e-a10b-0941514929b4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.405173] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.405369] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.405369] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.405489] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.405575] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.405672] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5afc8a2a-3bb1-4c3e-a10b-0941514929b4',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.439368] env[65337]: INFO networking_nsxv3.common.synchronization [req-467871f3-3a43-4600-91b6-e7b162426402 req-e525b7f6-d0e7-481f-a2fa-1d4a06e67355 tempest-AttachInterfacesUnderV243Test-1010804015 tempest-AttachInterfacesUnderV243Test-1010804015-project-member] Enqueued Resource ID: 5afc8a2a-3bb1-4c3e-a10b-0941514929b4 with Priority: HIGHEST for action security_group_rules [ 676.439672] env[65337]: INFO networking_nsxv3.common.synchronization [req-467871f3-3a43-4600-91b6-e7b162426402 req-e525b7f6-d0e7-481f-a2fa-1d4a06e67355 tempest-AttachInterfacesUnderV243Test-1010804015 tempest-AttachInterfacesUnderV243Test-1010804015-project-member] Enqueued Resource ID: 5afc8a2a-3bb1-4c3e-a10b-0941514929b4 with Priority: HIGHEST for action security_group_members [ 676.439827] env[65337]: INFO networking_nsxv3.common.synchronization [req-467871f3-3a43-4600-91b6-e7b162426402 req-e525b7f6-d0e7-481f-a2fa-1d4a06e67355 tempest-AttachInterfacesUnderV243Test-1010804015 tempest-AttachInterfacesUnderV243Test-1010804015-project-member] Enqueued Resource ID: f8737cbe-9807-4a6f-ae30-f63a1d167ad5 with Priority: HIGHEST for action port [ 676.440400] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5afc8a2a-3bb1-4c3e-a10b-0941514929b4 with Priority: HIGHEST for action security_group_rules [ 676.440589] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5afc8a2a-3bb1-4c3e-a10b-0941514929b4 with Priority: HIGHEST for action security_group_members [ 676.440715] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8737cbe-9807-4a6f-ae30-f63a1d167ad5 with Priority: HIGHEST for action port [ 676.441036] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5afc8a2a-3bb1-4c3e-a10b-0941514929b4 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.441184] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5afc8a2a-3bb1-4c3e-a10b-0941514929b4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.441247] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5afc8a2a-3bb1-4c3e-a10b-0941514929b4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.441545] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5afc8a2a-3bb1-4c3e-a10b-0941514929b4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.441866] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5afc8a2a-3bb1-4c3e-a10b-0941514929b4',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.442782] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-5afc8a2a-3bb1-4c3e-a10b-0941514929b4 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.442886] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5afc8a2a-3bb1-4c3e-a10b-0941514929b4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.444277] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-f8737cbe-9807-4a6f-ae30-f63a1d167ad5 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.444277] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f8737cbe-9807-4a6f-ae30-f63a1d167ad5" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.444277] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f8737cbe-9807-4a6f-ae30-f63a1d167ad5" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.444277] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f8737cbe-9807-4a6f-ae30-f63a1d167ad5" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.444277] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f8737cbe-9807-4a6f-ae30-f63a1d167ad5',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.629477] env[65337]: INFO networking_nsxv3.common.synchronization [req-e38b4f73-d42e-40dc-a392-036e18d65fa9 req-29071a5d-6cb3-487f-9118-4ca5f4fe1657 tempest-SecurityGroupRulesTestJSON-1213382043 tempest-SecurityGroupRulesTestJSON-1213382043-project-member] Enqueued Resource ID: e17d771b-d553-4433-94af-121efb9afa45 with Priority: HIGHEST for action security_group_rules [ 676.629477] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e17d771b-d553-4433-94af-121efb9afa45 with Priority: HIGHEST for action security_group_rules [ 676.629642] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e17d771b-d553-4433-94af-121efb9afa45 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.629723] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e17d771b-d553-4433-94af-121efb9afa45" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.629782] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e17d771b-d553-4433-94af-121efb9afa45" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.629978] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e17d771b-d553-4433-94af-121efb9afa45" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.631146] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e17d771b-d553-4433-94af-121efb9afa45',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.700405] env[65337]: INFO networking_nsxv3.common.synchronization [req-5e136c4a-3d31-4c53-b2c7-ad7453f7014d req-854606ce-0752-4b46-b7f5-c4eb0181b2d7 tempest-ServerDiskConfigTestJSON-1745593668 tempest-ServerDiskConfigTestJSON-1745593668-project-member] Enqueued Resource ID: 653446ea-2b31-43b8-a920-884274265c75 with Priority: HIGHEST for action security_group_members [ 676.701320] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 653446ea-2b31-43b8-a920-884274265c75 with Priority: HIGHEST for action security_group_members [ 676.701709] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.701846] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.701911] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.702134] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.702230] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.702417] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.702530] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.702580] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.702733] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.702818] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.702894] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4c4fbaa-f4c9-4326-babb-bda6619acdf6 is going to be updated. [ 676.704759] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-653446ea-2b31-43b8-a920-884274265c75 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.706582] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.706582] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.706582] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.706582] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.706582] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.706582] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.706582] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.706582] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.706582] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('653446ea-2b31-43b8-a920-884274265c75',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.739723] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.739921] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.739921] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.740605] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.740605] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.754270] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4c4fbaa-f4c9-4326-babb-bda6619acdf6 in Status: IN_PROGRESS for 2s [ 676.772551] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3cc33494-7b08-499a-b8bc-a9ae6b25d9d2',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.908223] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5afc8a2a-3bb1-4c3e-a10b-0941514929b4',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.946025] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-5afc8a2a-3bb1-4c3e-a10b-0941514929b4 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.946025] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5afc8a2a-3bb1-4c3e-a10b-0941514929b4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.946025] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f8737cbe-9807-4a6f-ae30-f63a1d167ad5 with status ACTIVE [ 676.946258] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.946335] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.946398] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.946613] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.946699] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.946864] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.946956] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.947028] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.947179] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.947252] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.947426] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.947513] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.947575] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.947740] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.947812] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.947895] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f8737cbe-9807-4a6f-ae30-f63a1d167ad5 is going to be updated. [ 676.969673] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.969891] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.970038] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.970594] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.970737] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.970953] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f8737cbe-9807-4a6f-ae30-f63a1d167ad5" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.132645] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock network-73 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.132871] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "network-73" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.132956] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "network-73" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.133301] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "network-73" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.134333] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.134333] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.134518] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.134659] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.134809] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.135560] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 677.135676] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 677.135778] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 677.135880] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 677.135986] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 677.136137] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 677.136258] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 677.161711] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 677.161873] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 677.162013] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 677.162312] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "network-73" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.162624] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock port-cf8d6daf-7242-4136-9e3e-90bc2c1bc239 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.162793] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "port-cf8d6daf-7242-4136-9e3e-90bc2c1bc239" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.162909] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "port-cf8d6daf-7242-4136-9e3e-90bc2c1bc239" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.163253] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "port-cf8d6daf-7242-4136-9e3e-90bc2c1bc239" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.163390] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cf8d6daf-7242-4136-9e3e-90bc2c1bc239',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.165199] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.165365] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.165422] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.165565] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.165652] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.165742] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e17d771b-d553-4433-94af-121efb9afa45 already deleted. [ 677.165822] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e17d771b-d553-4433-94af-121efb9afa45" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.212023] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.212023] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.212023] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.212023] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.212481] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.212481] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.212481] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.212481] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.212649] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.212690] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.212745] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 653446ea-2b31-43b8-a920-884274265c75 already deleted. [ 677.212831] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.281510] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.281679] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.281745] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.282812] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.282812] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.282812] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3cc33494-7b08-499a-b8bc-a9ae6b25d9d2 is going to be created. [ 677.328068] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.328249] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.328294] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.328514] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.328671] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.345042] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3cc33494-7b08-499a-b8bc-a9ae6b25d9d2 in Status: UNINITIALIZED for 2s [ 677.410964] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5afc8a2a-3bb1-4c3e-a10b-0941514929b4',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.647020] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 51b69fea-e790-4b59-8a34-41bdb9264f84 in Status: SUCCESS [ 677.647241] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 51b69fea-e790-4b59-8a34-41bdb9264f84 deletion is rescheduled due to dependency. [ 677.647329] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-51b69fea-e790-4b59-8a34-41bdb9264f84" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.668088] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.668590] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.668778] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.669098] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.669311] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.669496] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Segment Port cf8d6daf-7242-4136-9e3e-90bc2c1bc239 not found, creating... [ 677.669798] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.670072] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.670488] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.670488] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.670708] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.671036] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.671239] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.671632] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.671685] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.671797] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.672069] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Resource: SegmentPort with ID: cf8d6daf-7242-4136-9e3e-90bc2c1bc239 is going to be created. [ 677.695159] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.695446] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.695617] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.696084] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.696394] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.696680] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "port-cf8d6daf-7242-4136-9e3e-90bc2c1bc239" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.730116] env[65337]: INFO networking_nsxv3.common.synchronization [req-3d78114f-9ae4-4cb3-8abe-ed527c85a019 req-39e39c42-9ed6-490f-9742-584ec7b2cdd4 tempest-ServersNegativeTestJSON-62579270 tempest-ServersNegativeTestJSON-62579270-project-member] Enqueued Resource ID: b2e84376-5c9f-45e7-9949-59bf17a96c95 with Priority: HIGHEST for action security_group_members [ 677.730474] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2e84376-5c9f-45e7-9949-59bf17a96c95 with Priority: HIGHEST for action security_group_members [ 677.730827] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-b2e84376-5c9f-45e7-9949-59bf17a96c95 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.730974] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b2e84376-5c9f-45e7-9949-59bf17a96c95" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.731087] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b2e84376-5c9f-45e7-9949-59bf17a96c95" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.731323] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b2e84376-5c9f-45e7-9949-59bf17a96c95" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.731855] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.731855] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.731855] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.732044] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.732044] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.732160] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b2e84376-5c9f-45e7-9949-59bf17a96c95',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.915312] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.915487] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.915695] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.915795] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.915871] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.916039] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5afc8a2a-3bb1-4c3e-a10b-0941514929b4 is going to be updated. [ 677.945335] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.945471] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.946112] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.946112] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.946112] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.955689] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5afc8a2a-3bb1-4c3e-a10b-0941514929b4 in Status: IN_PROGRESS for 2s [ 678.236603] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b2e84376-5c9f-45e7-9949-59bf17a96c95',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.459792] env[65337]: INFO networking_nsxv3.common.synchronization [req-5e136c4a-3d31-4c53-b2c7-ad7453f7014d req-9388452f-e75e-4d7e-813d-fef2bc864e26 service nova] Enqueued Resource ID: 653446ea-2b31-43b8-a920-884274265c75 with Priority: HIGHEST for action security_group_rules [ 678.459792] env[65337]: INFO networking_nsxv3.common.synchronization [req-5e136c4a-3d31-4c53-b2c7-ad7453f7014d req-9388452f-e75e-4d7e-813d-fef2bc864e26 service nova] Enqueued Resource ID: 653446ea-2b31-43b8-a920-884274265c75 with Priority: HIGHEST for action security_group_members [ 678.460605] env[65337]: INFO networking_nsxv3.common.synchronization [req-5e136c4a-3d31-4c53-b2c7-ad7453f7014d req-9388452f-e75e-4d7e-813d-fef2bc864e26 service nova] Enqueued Resource ID: cf8d6daf-7242-4136-9e3e-90bc2c1bc239 with Priority: HIGHEST for action port [ 678.461711] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 653446ea-2b31-43b8-a920-884274265c75 with Priority: HIGHEST for action security_group_rules [ 678.462026] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 653446ea-2b31-43b8-a920-884274265c75 with Priority: HIGHEST for action security_group_members [ 678.462026] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf8d6daf-7242-4136-9e3e-90bc2c1bc239 with Priority: HIGHEST for action port [ 678.463643] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-653446ea-2b31-43b8-a920-884274265c75 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.463643] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.463643] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.463643] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.463643] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('653446ea-2b31-43b8-a920-884274265c75',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.464404] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-653446ea-2b31-43b8-a920-884274265c75 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.464507] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.464507] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.464834] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.465029] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.465152] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.465152] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.465318] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.465511] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.465604] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('653446ea-2b31-43b8-a920-884274265c75',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.467936] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-cf8d6daf-7242-4136-9e3e-90bc2c1bc239 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.468130] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cf8d6daf-7242-4136-9e3e-90bc2c1bc239" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.468229] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cf8d6daf-7242-4136-9e3e-90bc2c1bc239" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.468409] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cf8d6daf-7242-4136-9e3e-90bc2c1bc239" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.468516] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cf8d6daf-7242-4136-9e3e-90bc2c1bc239',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.739072] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b2e84376-5c9f-45e7-9949-59bf17a96c95',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.764573] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4c4fbaa-f4c9-4326-babb-bda6619acdf6 in Status: SUCCESS [ 678.764573] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4c4fbaa-f4c9-4326-babb-bda6619acdf6 deletion is rescheduled due to dependency. [ 678.764573] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4c4fbaa-f4c9-4326-babb-bda6619acdf6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.971436] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-653446ea-2b31-43b8-a920-884274265c75 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.971576] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.971827] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cf8d6daf-7242-4136-9e3e-90bc2c1bc239 with status ACTIVE [ 678.972016] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.972145] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.972212] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.972434] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.972523] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.972693] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.972789] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.972848] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.972997] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.973089] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.973318] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.973414] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.973487] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.973627] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.973702] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.973787] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cf8d6daf-7242-4136-9e3e-90bc2c1bc239 is going to be updated. [ 678.975242] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('653446ea-2b31-43b8-a920-884274265c75',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.001666] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.001856] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.001929] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.002169] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.002306] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.002466] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cf8d6daf-7242-4136-9e3e-90bc2c1bc239" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.242077] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.242459] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.242459] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.242549] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.242773] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.242773] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b2e84376-5c9f-45e7-9949-59bf17a96c95 is going to be updated. [ 679.276280] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.276498] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.276588] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.276833] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.277168] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.287619] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b2e84376-5c9f-45e7-9949-59bf17a96c95 in Status: IN_PROGRESS for 2s [ 679.355482] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3cc33494-7b08-499a-b8bc-a9ae6b25d9d2 in Status: SUCCESS [ 679.355701] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3cc33494-7b08-499a-b8bc-a9ae6b25d9d2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.356374] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3cc33494-7b08-499a-b8bc-a9ae6b25d9d2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.356374] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3cc33494-7b08-499a-b8bc-a9ae6b25d9d2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.356461] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.356527] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.356594] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.356772] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.356899] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.356998] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3cc33494-7b08-499a-b8bc-a9ae6b25d9d2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.357147] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3cc33494-7b08-499a-b8bc-a9ae6b25d9d2',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.478356] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('653446ea-2b31-43b8-a920-884274265c75',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.823107] env[65337]: INFO networking_nsxv3.common.synchronization [req-ac03cdd5-54a4-4c8a-b556-76474cb81ab8 req-f56c94fe-0124-4b61-b6c3-533d1910754f tempest-DeleteServersTestJSON-1654690426 tempest-DeleteServersTestJSON-1654690426-project-member] Enqueued Resource ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d with Priority: HIGHEST for action security_group_members [ 679.823107] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d with Priority: HIGHEST for action security_group_members [ 679.823107] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-161889a4-32a2-48ee-8fb7-d2a961a4b28d taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.823107] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.823107] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.823107] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.823107] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.823107] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.823107] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.823107] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.823107] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.823107] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('161889a4-32a2-48ee-8fb7-d2a961a4b28d',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.863160] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-3cc33494-7b08-499a-b8bc-a9ae6b25d9d2 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.863662] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3cc33494-7b08-499a-b8bc-a9ae6b25d9d2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.863733] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3cc33494-7b08-499a-b8bc-a9ae6b25d9d2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.863993] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3cc33494-7b08-499a-b8bc-a9ae6b25d9d2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.864203] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.864373] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.864459] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.864628] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.864737] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.864842] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3cc33494-7b08-499a-b8bc-a9ae6b25d9d2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.865049] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-3cc33494-7b08-499a-b8bc-a9ae6b25d9d2 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.865160] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3cc33494-7b08-499a-b8bc-a9ae6b25d9d2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.865367] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3cc33494-7b08-499a-b8bc-a9ae6b25d9d2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.865477] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3cc33494-7b08-499a-b8bc-a9ae6b25d9d2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.865554] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.865660] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.865731] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.865882] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.865948] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.866302] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3cc33494-7b08-499a-b8bc-a9ae6b25d9d2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.866421] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3cc33494-7b08-499a-b8bc-a9ae6b25d9d2',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.967523] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5afc8a2a-3bb1-4c3e-a10b-0941514929b4 in Status: SUCCESS [ 679.967734] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5afc8a2a-3bb1-4c3e-a10b-0941514929b4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.967903] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5afc8a2a-3bb1-4c3e-a10b-0941514929b4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.968418] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5afc8a2a-3bb1-4c3e-a10b-0941514929b4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.968632] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.968770] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.968848] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.969028] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.969114] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.969212] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5afc8a2a-3bb1-4c3e-a10b-0941514929b4',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.980621] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.980820] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.980878] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.981836] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.981947] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.982044] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 653446ea-2b31-43b8-a920-884274265c75 is going to be created. [ 680.012792] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.013026] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.013026] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.014345] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.014531] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.029570] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 653446ea-2b31-43b8-a920-884274265c75 in Status: UNINITIALIZED for 2s [ 680.325384] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.325762] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.325762] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.326064] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.326173] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.326717] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.326717] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.326717] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.326979] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.326979] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.327150] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d already deleted. [ 680.327211] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.369326] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3cc33494-7b08-499a-b8bc-a9ae6b25d9d2: rpc.has_security_group_logging(os_id): False [ 680.389057] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.393589] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.393589] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.393589] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.393589] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.393589] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.393589] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.393589] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.393589] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.393589] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.393589] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.393589] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.393589] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.393589] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.393589] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.394908] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.395198] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.395581] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.395847] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.396068] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.396252] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3cc33494-7b08-499a-b8bc-a9ae6b25d9d2 is going to be created. [ 680.404462] env[65337]: INFO networking_nsxv3.common.synchronization [None req-e78ae398-eb0e-41e2-98d6-a3eca2d8f205 None None] Enqueued Resource ID: 7fbb7a12-bd27-454e-864f-59c1a56b95a6 with Priority: HIGHEST for action port [ 680.404462] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fbb7a12-bd27-454e-864f-59c1a56b95a6 with Priority: HIGHEST for action port [ 680.404462] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-7fbb7a12-bd27-454e-864f-59c1a56b95a6 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.404462] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7fbb7a12-bd27-454e-864f-59c1a56b95a6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.404462] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7fbb7a12-bd27-454e-864f-59c1a56b95a6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.404907] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7fbb7a12-bd27-454e-864f-59c1a56b95a6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.404907] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7fbb7a12-bd27-454e-864f-59c1a56b95a6',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.472296] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5afc8a2a-3bb1-4c3e-a10b-0941514929b4',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.526305] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.526305] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.526305] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.526305] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.526305] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.547194] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3cc33494-7b08-499a-b8bc-a9ae6b25d9d2 in Status: IN_PROGRESS for 2s [ 680.847748] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock network-211 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.848741] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "network-211" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.848741] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "network-211" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.852026] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "network-211" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.852026] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.852026] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.852026] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.852026] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.852026] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.852026] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 680.852026] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 680.852026] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 680.852026] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 680.852026] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 680.852026] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 680.852026] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 680.871988] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 680.872209] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 680.872760] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 680.872760] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "network-211" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.872760] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock port-e5072ad6-f9f1-43a4-9857-b9e174baf209 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.873191] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "port-e5072ad6-f9f1-43a4-9857-b9e174baf209" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.873191] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "port-e5072ad6-f9f1-43a4-9857-b9e174baf209" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.873378] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "port-e5072ad6-f9f1-43a4-9857-b9e174baf209" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.873503] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e5072ad6-f9f1-43a4-9857-b9e174baf209',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.908686] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7fbb7a12-bd27-454e-864f-59c1a56b95a6 [ 680.909064] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.910785] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.910878] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.912254] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.912254] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.912254] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7fbb7a12-bd27-454e-864f-59c1a56b95a6 already deleted. [ 680.912254] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7fbb7a12-bd27-454e-864f-59c1a56b95a6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.974609] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5afc8a2a-3bb1-4c3e-a10b-0941514929b4',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.214815] env[65337]: INFO networking_nsxv3.common.synchronization [None req-80b84dff-ed8c-44e2-83f6-0e272b022264 None None] Enqueued Resource ID: bdef972e-d637-45bf-a455-6c490f3efb73 with Priority: HIGHEST for action port [ 681.215518] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdef972e-d637-45bf-a455-6c490f3efb73 with Priority: HIGHEST for action port [ 681.215866] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-bdef972e-d637-45bf-a455-6c490f3efb73 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.215997] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bdef972e-d637-45bf-a455-6c490f3efb73" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.216071] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bdef972e-d637-45bf-a455-6c490f3efb73" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.216357] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bdef972e-d637-45bf-a455-6c490f3efb73" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.216460] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bdef972e-d637-45bf-a455-6c490f3efb73',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.298367] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b2e84376-5c9f-45e7-9949-59bf17a96c95 in Status: SUCCESS [ 681.298367] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b2e84376-5c9f-45e7-9949-59bf17a96c95" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.376589] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.376857] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.376857] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.377207] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.377258] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.377408] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Segment Port e5072ad6-f9f1-43a4-9857-b9e174baf209 not found, creating... [ 681.377679] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.377830] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.378584] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.378584] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.378584] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.378584] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.378874] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.378874] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.378958] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.379488] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.379614] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Resource: SegmentPort with ID: e5072ad6-f9f1-43a4-9857-b9e174baf209 is going to be created. [ 681.401630] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.406026] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.406026] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.406026] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.406026] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.406026] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "port-e5072ad6-f9f1-43a4-9857-b9e174baf209" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.477186] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.477407] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.477479] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.477722] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.477808] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.477881] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5afc8a2a-3bb1-4c3e-a10b-0941514929b4 is going to be updated. [ 681.510810] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.511040] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.511097] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.511577] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.511577] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.528702] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5afc8a2a-3bb1-4c3e-a10b-0941514929b4 in Status: IN_PROGRESS for 2s [ 681.721929] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bdef972e-d637-45bf-a455-6c490f3efb73 [ 681.722108] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.722210] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.722284] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.722531] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.722629] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.722705] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bdef972e-d637-45bf-a455-6c490f3efb73 already deleted. [ 681.722786] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bdef972e-d637-45bf-a455-6c490f3efb73" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.041756] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 653446ea-2b31-43b8-a920-884274265c75 in Status: SUCCESS [ 682.042033] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.042233] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.042449] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.042646] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.042770] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.042834] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.042987] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.043082] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.043165] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.043254] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('653446ea-2b31-43b8-a920-884274265c75',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.059042] env[65337]: INFO networking_nsxv3.common.synchronization [None req-e1da3df1-b70f-43a1-ade3-8f848c28ad0d None None] Enqueued Resource ID: 9959baee-4218-4324-8676-4c9658226044 with Priority: HIGHEST for action port [ 682.059042] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9959baee-4218-4324-8676-4c9658226044 with Priority: HIGHEST for action port [ 682.059042] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-9959baee-4218-4324-8676-4c9658226044 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.059265] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9959baee-4218-4324-8676-4c9658226044" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.059265] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9959baee-4218-4324-8676-4c9658226044" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.059479] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9959baee-4218-4324-8676-4c9658226044" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.059580] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9959baee-4218-4324-8676-4c9658226044',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.125031] env[65337]: INFO networking_nsxv3.common.synchronization [req-ac03cdd5-54a4-4c8a-b556-76474cb81ab8 req-4e3ff68a-1de2-474d-8bb7-b0fa7f599637 service nova] Enqueued Resource ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d with Priority: HIGHEST for action security_group_rules [ 682.125031] env[65337]: INFO networking_nsxv3.common.synchronization [req-ac03cdd5-54a4-4c8a-b556-76474cb81ab8 req-4e3ff68a-1de2-474d-8bb7-b0fa7f599637 service nova] Enqueued Resource ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d with Priority: HIGHEST for action security_group_members [ 682.125031] env[65337]: INFO networking_nsxv3.common.synchronization [req-ac03cdd5-54a4-4c8a-b556-76474cb81ab8 req-4e3ff68a-1de2-474d-8bb7-b0fa7f599637 service nova] Enqueued Resource ID: e5072ad6-f9f1-43a4-9857-b9e174baf209 with Priority: HIGHEST for action port [ 682.125031] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d with Priority: HIGHEST for action security_group_rules [ 682.125382] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d with Priority: HIGHEST for action security_group_members [ 682.125382] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5072ad6-f9f1-43a4-9857-b9e174baf209 with Priority: HIGHEST for action port [ 682.125691] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-161889a4-32a2-48ee-8fb7-d2a961a4b28d taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.125866] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.125962] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.126395] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.126588] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('161889a4-32a2-48ee-8fb7-d2a961a4b28d',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.127507] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-161889a4-32a2-48ee-8fb7-d2a961a4b28d taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.127659] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.127748] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.128465] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.128465] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.128465] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.128465] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.128465] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.128695] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.128954] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('161889a4-32a2-48ee-8fb7-d2a961a4b28d',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.130655] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-e5072ad6-f9f1-43a4-9857-b9e174baf209 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.130655] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e5072ad6-f9f1-43a4-9857-b9e174baf209" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.130655] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e5072ad6-f9f1-43a4-9857-b9e174baf209" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.130655] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e5072ad6-f9f1-43a4-9857-b9e174baf209" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.130655] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e5072ad6-f9f1-43a4-9857-b9e174baf209',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.510056] env[65337]: INFO networking_nsxv3.common.synchronization [req-42bdea82-a5c7-4d00-a7fd-61b7de22ad7c req-c3226f4e-1e51-419d-9d85-b3c0ef84faef tempest-ImagesOneServerTestJSON-752365409 tempest-ImagesOneServerTestJSON-752365409-project-member] Enqueued Resource ID: b2d083bb-47e2-4637-be9f-9dbd7dc68026 with Priority: HIGHEST for action security_group_members [ 682.510548] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2d083bb-47e2-4637-be9f-9dbd7dc68026 with Priority: HIGHEST for action security_group_members [ 682.510857] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-b2d083bb-47e2-4637-be9f-9dbd7dc68026 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.511078] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b2d083bb-47e2-4637-be9f-9dbd7dc68026" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.515135] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b2d083bb-47e2-4637-be9f-9dbd7dc68026" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.515456] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b2d083bb-47e2-4637-be9f-9dbd7dc68026" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.515655] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.515788] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.515835] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.515992] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.516097] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.516196] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b2d083bb-47e2-4637-be9f-9dbd7dc68026',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.548058] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-653446ea-2b31-43b8-a920-884274265c75 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.548058] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.548058] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.548058] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.548058] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.548058] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.548058] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.548058] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.548058] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.548058] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.548058] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-653446ea-2b31-43b8-a920-884274265c75 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.548526] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.548526] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.548526] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.548526] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.548526] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.548702] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.548702] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.548764] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.548798] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.549229] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('653446ea-2b31-43b8-a920-884274265c75',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.561669] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3cc33494-7b08-499a-b8bc-a9ae6b25d9d2 in Status: SUCCESS [ 682.561843] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3cc33494-7b08-499a-b8bc-a9ae6b25d9d2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.567890] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9959baee-4218-4324-8676-4c9658226044 [ 682.567890] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.567890] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.567890] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.567890] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.567890] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.567890] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9959baee-4218-4324-8676-4c9658226044 already deleted. [ 682.567890] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9959baee-4218-4324-8676-4c9658226044" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.632214] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('161889a4-32a2-48ee-8fb7-d2a961a4b28d',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.634579] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-161889a4-32a2-48ee-8fb7-d2a961a4b28d taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.634579] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.634579] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e5072ad6-f9f1-43a4-9857-b9e174baf209 with status ACTIVE [ 682.634763] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.634763] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.634882] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.634988] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.635154] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.635327] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.635470] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.636387] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.636539] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.636622] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.636815] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.636910] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.637026] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.637170] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.637305] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.637305] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e5072ad6-f9f1-43a4-9857-b9e174baf209 is going to be updated. [ 682.661394] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.661633] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.661711] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.661915] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.662062] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.662221] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e5072ad6-f9f1-43a4-9857-b9e174baf209" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.007221] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock network-668 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.007413] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "network-668" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.007532] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "network-668" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.007847] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "network-668" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.008115] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.008288] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.008485] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.008591] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.008781] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.008997] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 683.009164] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 683.009372] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 683.009465] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 683.009568] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 683.009683] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 683.009812] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 683.022637] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.022637] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.022637] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.022637] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.022637] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.022637] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.022637] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.022637] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.022637] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.022637] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.022637] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b2d083bb-47e2-4637-be9f-9dbd7dc68026 already deleted. [ 683.022637] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b2d083bb-47e2-4637-be9f-9dbd7dc68026" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.033983] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 683.033983] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 683.033983] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 683.033983] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "network-668" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.033983] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock port-5c9aa6db-76bb-4999-baac-53015c0448cf taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.033983] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "port-5c9aa6db-76bb-4999-baac-53015c0448cf" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.033983] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "port-5c9aa6db-76bb-4999-baac-53015c0448cf" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.033983] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "port-5c9aa6db-76bb-4999-baac-53015c0448cf" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.033983] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5c9aa6db-76bb-4999-baac-53015c0448cf',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.054326] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 653446ea-2b31-43b8-a920-884274265c75: rpc.has_security_group_logging(os_id): False [ 683.072257] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.072468] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.072468] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.072670] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.072756] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.073010] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.073155] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.073218] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.073369] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.073442] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.073622] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.073713] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.073766] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.073962] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.074910] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.075304] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.075386] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.075438] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.075574] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.075655] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.075737] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 653446ea-2b31-43b8-a920-884274265c75 is going to be created. [ 683.133203] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.133340] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.133410] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.133607] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.133782] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.139673] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('161889a4-32a2-48ee-8fb7-d2a961a4b28d',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.147455] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 653446ea-2b31-43b8-a920-884274265c75 in Status: IN_PROGRESS for 2s [ 683.536584] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.536908] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.536978] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.537429] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.537645] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.537843] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Segment Port 5c9aa6db-76bb-4999-baac-53015c0448cf not found, creating... [ 683.538211] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.538420] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.538595] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.538965] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.543543] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.543543] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.545225] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.545225] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.545225] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.545225] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.545225] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Resource: SegmentPort with ID: 5c9aa6db-76bb-4999-baac-53015c0448cf is going to be created. [ 683.548219] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5afc8a2a-3bb1-4c3e-a10b-0941514929b4 in Status: SUCCESS [ 683.548451] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5afc8a2a-3bb1-4c3e-a10b-0941514929b4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.548661] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5afc8a2a-3bb1-4c3e-a10b-0941514929b4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.548924] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5afc8a2a-3bb1-4c3e-a10b-0941514929b4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.549138] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.549279] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.549354] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.549590] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.549709] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.549801] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5afc8a2a-3bb1-4c3e-a10b-0941514929b4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.549924] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5afc8a2a-3bb1-4c3e-a10b-0941514929b4',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.574722] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.574955] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.575452] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.575758] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.576123] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.576389] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "port-5c9aa6db-76bb-4999-baac-53015c0448cf" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.643508] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.643508] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.643508] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.643508] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.643508] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.644040] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d is going to be created. [ 683.712641] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.712789] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.712858] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.713089] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.713245] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.731145] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d in Status: UNINITIALIZED for 2s [ 684.054157] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5afc8a2a-3bb1-4c3e-a10b-0941514929b4',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.089772] env[65337]: INFO networking_nsxv3.common.synchronization [None req-ee5ebfb1-7bfe-483a-ad76-2a1f5cecdd92 None None] Enqueued Resource ID: 0e053304-c532-4b25-9064-4343ec2ac530 with Priority: HIGHEST for action port [ 684.091822] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e053304-c532-4b25-9064-4343ec2ac530 with Priority: HIGHEST for action port [ 684.091822] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-0e053304-c532-4b25-9064-4343ec2ac530 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.091822] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0e053304-c532-4b25-9064-4343ec2ac530" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.091822] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0e053304-c532-4b25-9064-4343ec2ac530" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.091822] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0e053304-c532-4b25-9064-4343ec2ac530" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.091822] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0e053304-c532-4b25-9064-4343ec2ac530',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.342712] env[65337]: INFO networking_nsxv3.common.synchronization [None req-6c3a6cba-6a52-450f-a63d-b719f0e2befa tempest-ServersTestBootFromVolume-1626214960 tempest-ServersTestBootFromVolume-1626214960-project-member] Enqueued Resource ID: 4fe2934b-ab8b-4bda-9010-1a9725b2c40c with Priority: HIGHEST for action security_group_rules [ 684.343304] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fe2934b-ab8b-4bda-9010-1a9725b2c40c with Priority: HIGHEST for action security_group_rules [ 684.343723] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4fe2934b-ab8b-4bda-9010-1a9725b2c40c taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.343723] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4fe2934b-ab8b-4bda-9010-1a9725b2c40c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.343908] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4fe2934b-ab8b-4bda-9010-1a9725b2c40c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.344571] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4fe2934b-ab8b-4bda-9010-1a9725b2c40c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.344571] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4fe2934b-ab8b-4bda-9010-1a9725b2c40c',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.373110] env[65337]: INFO networking_nsxv3.common.synchronization [req-42bdea82-a5c7-4d00-a7fd-61b7de22ad7c req-ce0fab7e-2044-4ce1-a3fc-01e37414139e service nova] Enqueued Resource ID: b2d083bb-47e2-4637-be9f-9dbd7dc68026 with Priority: HIGHEST for action security_group_rules [ 684.373305] env[65337]: INFO networking_nsxv3.common.synchronization [req-42bdea82-a5c7-4d00-a7fd-61b7de22ad7c req-ce0fab7e-2044-4ce1-a3fc-01e37414139e service nova] Enqueued Resource ID: b2d083bb-47e2-4637-be9f-9dbd7dc68026 with Priority: HIGHEST for action security_group_members [ 684.373438] env[65337]: INFO networking_nsxv3.common.synchronization [req-42bdea82-a5c7-4d00-a7fd-61b7de22ad7c req-ce0fab7e-2044-4ce1-a3fc-01e37414139e service nova] Enqueued Resource ID: 5c9aa6db-76bb-4999-baac-53015c0448cf with Priority: HIGHEST for action port [ 684.375166] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2d083bb-47e2-4637-be9f-9dbd7dc68026 with Priority: HIGHEST for action security_group_rules [ 684.376041] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2d083bb-47e2-4637-be9f-9dbd7dc68026 with Priority: HIGHEST for action security_group_members [ 684.376279] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c9aa6db-76bb-4999-baac-53015c0448cf with Priority: HIGHEST for action port [ 684.376623] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b2d083bb-47e2-4637-be9f-9dbd7dc68026 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.376758] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b2d083bb-47e2-4637-be9f-9dbd7dc68026" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.376940] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b2d083bb-47e2-4637-be9f-9dbd7dc68026" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.377337] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b2d083bb-47e2-4637-be9f-9dbd7dc68026" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.377428] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b2d083bb-47e2-4637-be9f-9dbd7dc68026',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.378759] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-b2d083bb-47e2-4637-be9f-9dbd7dc68026 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.378928] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b2d083bb-47e2-4637-be9f-9dbd7dc68026" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.378992] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b2d083bb-47e2-4637-be9f-9dbd7dc68026" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.379322] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b2d083bb-47e2-4637-be9f-9dbd7dc68026" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.379503] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.379616] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.379679] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.379888] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.380654] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.380770] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b2d083bb-47e2-4637-be9f-9dbd7dc68026',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.382116] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-5c9aa6db-76bb-4999-baac-53015c0448cf taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.382116] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5c9aa6db-76bb-4999-baac-53015c0448cf" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.382116] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5c9aa6db-76bb-4999-baac-53015c0448cf" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.385332] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5c9aa6db-76bb-4999-baac-53015c0448cf" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.385425] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5c9aa6db-76bb-4999-baac-53015c0448cf',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.477152] env[65337]: INFO networking_nsxv3.common.synchronization [None req-7eadcd48-08ed-4f91-9f24-9349a9aeb7bb tempest-ServersTestBootFromVolume-1626214960 tempest-ServersTestBootFromVolume-1626214960-project-member] Enqueued Resource ID: 4fe2934b-ab8b-4bda-9010-1a9725b2c40c with Priority: HIGHEST for action security_group_rules [ 684.477331] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fe2934b-ab8b-4bda-9010-1a9725b2c40c with Priority: HIGHEST for action security_group_rules [ 684.478785] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4fe2934b-ab8b-4bda-9010-1a9725b2c40c taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.478785] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4fe2934b-ab8b-4bda-9010-1a9725b2c40c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.559498] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5afc8a2a-3bb1-4c3e-a10b-0941514929b4: rpc.has_security_group_logging(os_id): False [ 684.583026] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.583026] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.583026] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.583026] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.583026] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.583026] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.583026] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.583026] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.583026] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.583026] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.583026] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5afc8a2a-3bb1-4c3e-a10b-0941514929b4 is going to be updated. [ 684.595608] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0e053304-c532-4b25-9064-4343ec2ac530 [ 684.595989] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.597065] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.597168] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.599778] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.599778] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.599778] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0e053304-c532-4b25-9064-4343ec2ac530 already deleted. [ 684.599778] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0e053304-c532-4b25-9064-4343ec2ac530" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.673861] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.673861] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.673861] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.673861] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.674232] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.690821] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5afc8a2a-3bb1-4c3e-a10b-0941514929b4 in Status: IN_PROGRESS for 2s [ 684.883807] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.884058] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.884182] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.884477] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.884620] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.884760] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4fe2934b-ab8b-4bda-9010-1a9725b2c40c already deleted. [ 684.884895] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4fe2934b-ab8b-4bda-9010-1a9725b2c40c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.885140] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4fe2934b-ab8b-4bda-9010-1a9725b2c40c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.885377] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4fe2934b-ab8b-4bda-9010-1a9725b2c40c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.885497] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4fe2934b-ab8b-4bda-9010-1a9725b2c40c',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.886884] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-b2d083bb-47e2-4637-be9f-9dbd7dc68026 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.886986] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b2d083bb-47e2-4637-be9f-9dbd7dc68026" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.887195] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b2d083bb-47e2-4637-be9f-9dbd7dc68026',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.889877] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5c9aa6db-76bb-4999-baac-53015c0448cf with status ACTIVE [ 684.889877] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.889877] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.889877] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.889877] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.889877] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.890142] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.890142] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.890211] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.890906] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.890906] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.890906] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.890906] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.890906] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.891136] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.891136] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.891292] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5c9aa6db-76bb-4999-baac-53015c0448cf is going to be updated. [ 684.947052] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.947236] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.947514] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.947769] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.948156] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.948156] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5c9aa6db-76bb-4999-baac-53015c0448cf" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.167732] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 653446ea-2b31-43b8-a920-884274265c75 in Status: SUCCESS [ 685.167732] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.396019] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b2d083bb-47e2-4637-be9f-9dbd7dc68026',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.417264] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.417497] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.417497] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.417794] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.417896] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.417994] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4fe2934b-ab8b-4bda-9010-1a9725b2c40c already deleted. [ 685.418088] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4fe2934b-ab8b-4bda-9010-1a9725b2c40c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.746370] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d in Status: SUCCESS [ 685.748567] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.748567] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.748567] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.748567] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.748567] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.748567] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.748567] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.748567] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.748567] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.748567] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('161889a4-32a2-48ee-8fb7-d2a961a4b28d',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.900905] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.900905] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.900905] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.900905] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.900905] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.900905] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b2d083bb-47e2-4637-be9f-9dbd7dc68026 is going to be created. [ 685.943136] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.943136] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.943136] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.943136] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.943136] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.955294] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b2d083bb-47e2-4637-be9f-9dbd7dc68026 in Status: UNINITIALIZED for 2s [ 686.256314] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-161889a4-32a2-48ee-8fb7-d2a961a4b28d taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.256314] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.256314] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.256314] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.256314] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.256314] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.256314] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.256314] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.256314] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.256314] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.256314] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-161889a4-32a2-48ee-8fb7-d2a961a4b28d taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.256314] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.257357] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.257357] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.257357] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.257357] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.257357] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.257357] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.257357] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.257357] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.257357] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('161889a4-32a2-48ee-8fb7-d2a961a4b28d',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.709133] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5afc8a2a-3bb1-4c3e-a10b-0941514929b4 in Status: SUCCESS [ 686.709133] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5afc8a2a-3bb1-4c3e-a10b-0941514929b4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.764026] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 161889a4-32a2-48ee-8fb7-d2a961a4b28d: rpc.has_security_group_logging(os_id): False [ 686.790030] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.790293] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.790416] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.794052] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.794052] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.794052] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.794052] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.794439] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.794796] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.796034] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.796246] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.796396] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.796455] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.796715] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.796760] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.797355] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.797355] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.797355] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.797355] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.797507] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.797507] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d is going to be created. [ 686.887053] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.887206] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.887297] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.887477] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.887657] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.904378] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d in Status: IN_PROGRESS for 2s [ 687.708429] env[65337]: INFO networking_nsxv3.common.synchronization [req-082f8594-8d23-4f1b-8030-5a883a62b335 req-a7528248-f7d5-4162-a8c6-e68aed0dd65e tempest-AttachInterfacesUnderV243Test-1010804015 tempest-AttachInterfacesUnderV243Test-1010804015-project-member] Enqueued Resource ID: 5afc8a2a-3bb1-4c3e-a10b-0941514929b4 with Priority: HIGHEST for action security_group_members [ 687.709063] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5afc8a2a-3bb1-4c3e-a10b-0941514929b4 with Priority: HIGHEST for action security_group_members [ 687.709879] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-5afc8a2a-3bb1-4c3e-a10b-0941514929b4 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.710195] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5afc8a2a-3bb1-4c3e-a10b-0941514929b4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.710311] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5afc8a2a-3bb1-4c3e-a10b-0941514929b4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.710568] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5afc8a2a-3bb1-4c3e-a10b-0941514929b4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.710853] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.711100] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.711147] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.711283] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.711533] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.711661] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5afc8a2a-3bb1-4c3e-a10b-0941514929b4',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.727620] env[65337]: INFO networking_nsxv3.common.synchronization [req-082f8594-8d23-4f1b-8030-5a883a62b335 req-a7528248-f7d5-4162-a8c6-e68aed0dd65e tempest-AttachInterfacesUnderV243Test-1010804015 tempest-AttachInterfacesUnderV243Test-1010804015-project-member] Enqueued Resource ID: 5afc8a2a-3bb1-4c3e-a10b-0941514929b4 with Priority: HIGHEST for action security_group_rules [ 687.727882] env[65337]: INFO networking_nsxv3.common.synchronization [req-082f8594-8d23-4f1b-8030-5a883a62b335 req-a7528248-f7d5-4162-a8c6-e68aed0dd65e tempest-AttachInterfacesUnderV243Test-1010804015 tempest-AttachInterfacesUnderV243Test-1010804015-project-member] Enqueued Resource ID: 5afc8a2a-3bb1-4c3e-a10b-0941514929b4 with Priority: HIGHEST for action security_group_members [ 687.728090] env[65337]: INFO networking_nsxv3.common.synchronization [req-082f8594-8d23-4f1b-8030-5a883a62b335 req-a7528248-f7d5-4162-a8c6-e68aed0dd65e tempest-AttachInterfacesUnderV243Test-1010804015 tempest-AttachInterfacesUnderV243Test-1010804015-project-member] Enqueued Resource ID: f8737cbe-9807-4a6f-ae30-f63a1d167ad5 with Priority: HIGHEST for action port [ 687.728764] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5afc8a2a-3bb1-4c3e-a10b-0941514929b4 with Priority: HIGHEST for action security_group_rules [ 687.728947] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5afc8a2a-3bb1-4c3e-a10b-0941514929b4 with Priority: HIGHEST for action security_group_members [ 687.729055] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8737cbe-9807-4a6f-ae30-f63a1d167ad5 with Priority: HIGHEST for action port [ 687.729599] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5afc8a2a-3bb1-4c3e-a10b-0941514929b4 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.729754] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5afc8a2a-3bb1-4c3e-a10b-0941514929b4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.729801] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5afc8a2a-3bb1-4c3e-a10b-0941514929b4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.730351] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5afc8a2a-3bb1-4c3e-a10b-0941514929b4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.730498] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5afc8a2a-3bb1-4c3e-a10b-0941514929b4',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.731456] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-5afc8a2a-3bb1-4c3e-a10b-0941514929b4 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.731542] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5afc8a2a-3bb1-4c3e-a10b-0941514929b4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.734336] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-f8737cbe-9807-4a6f-ae30-f63a1d167ad5 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.734336] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f8737cbe-9807-4a6f-ae30-f63a1d167ad5" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.734336] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f8737cbe-9807-4a6f-ae30-f63a1d167ad5" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.734336] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f8737cbe-9807-4a6f-ae30-f63a1d167ad5" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.734336] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f8737cbe-9807-4a6f-ae30-f63a1d167ad5',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.967737] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b2d083bb-47e2-4637-be9f-9dbd7dc68026 in Status: SUCCESS [ 687.967737] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b2d083bb-47e2-4637-be9f-9dbd7dc68026" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.967737] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b2d083bb-47e2-4637-be9f-9dbd7dc68026" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.967737] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b2d083bb-47e2-4637-be9f-9dbd7dc68026" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.968156] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.968277] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.969100] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.969100] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.969100] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.969100] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b2d083bb-47e2-4637-be9f-9dbd7dc68026" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.969100] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b2d083bb-47e2-4637-be9f-9dbd7dc68026',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.214472] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5afc8a2a-3bb1-4c3e-a10b-0941514929b4',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.234164] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-5afc8a2a-3bb1-4c3e-a10b-0941514929b4 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.234331] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5afc8a2a-3bb1-4c3e-a10b-0941514929b4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.236034] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f8737cbe-9807-4a6f-ae30-f63a1d167ad5 with status ACTIVE [ 688.236321] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.236481] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.236621] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.238128] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.238128] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.238128] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.238128] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.238128] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.238128] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.238128] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.238128] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.238128] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.238433] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.238433] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.238433] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.238576] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f8737cbe-9807-4a6f-ae30-f63a1d167ad5 is going to be updated. [ 688.264657] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.264904] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.264904] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.265090] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.265226] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.265385] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f8737cbe-9807-4a6f-ae30-f63a1d167ad5" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.471519] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-b2d083bb-47e2-4637-be9f-9dbd7dc68026 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.471519] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b2d083bb-47e2-4637-be9f-9dbd7dc68026" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.471621] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b2d083bb-47e2-4637-be9f-9dbd7dc68026" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.471799] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b2d083bb-47e2-4637-be9f-9dbd7dc68026" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.471979] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.472097] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.472159] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.472305] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.472393] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.472479] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b2d083bb-47e2-4637-be9f-9dbd7dc68026" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.472681] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-b2d083bb-47e2-4637-be9f-9dbd7dc68026 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.472727] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b2d083bb-47e2-4637-be9f-9dbd7dc68026" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.472752] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b2d083bb-47e2-4637-be9f-9dbd7dc68026" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.472889] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b2d083bb-47e2-4637-be9f-9dbd7dc68026" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.473032] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.473123] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.473200] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.473330] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.473374] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.473473] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b2d083bb-47e2-4637-be9f-9dbd7dc68026" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.473541] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b2d083bb-47e2-4637-be9f-9dbd7dc68026',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.717365] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5afc8a2a-3bb1-4c3e-a10b-0941514929b4',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.921834] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d in Status: SUCCESS [ 688.922114] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.976610] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b2d083bb-47e2-4637-be9f-9dbd7dc68026: rpc.has_security_group_logging(os_id): False [ 689.002903] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.003108] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.003186] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.003414] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.003632] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.003806] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.003941] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.004044] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.004224] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.004652] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.004652] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.004652] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.004652] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.004832] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.004931] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.006042] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.007325] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.007325] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.008254] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.008442] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.008691] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b2d083bb-47e2-4637-be9f-9dbd7dc68026 is going to be created. [ 689.083318] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.083318] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.083556] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.083665] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.083824] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.103882] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b2d083bb-47e2-4637-be9f-9dbd7dc68026 in Status: IN_PROGRESS for 2s [ 689.220563] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.220738] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.220788] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.221023] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.221137] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.221247] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5afc8a2a-3bb1-4c3e-a10b-0941514929b4 is going to be updated. [ 689.284378] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.284378] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.284378] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.284608] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.285361] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.299457] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5afc8a2a-3bb1-4c3e-a10b-0941514929b4 in Status: IN_PROGRESS for 2s [ 690.035893] env[65337]: INFO networking_nsxv3.common.synchronization [None req-8e69b2fb-725b-41de-8b93-a6ca3e2f9b22 None None] Enqueued Resource ID: 52883b1a-74af-4f36-9cb4-1834015f09fe with Priority: HIGHEST for action port [ 690.040808] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52883b1a-74af-4f36-9cb4-1834015f09fe with Priority: HIGHEST for action port [ 690.041360] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-52883b1a-74af-4f36-9cb4-1834015f09fe taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.042359] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-52883b1a-74af-4f36-9cb4-1834015f09fe" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.043170] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-52883b1a-74af-4f36-9cb4-1834015f09fe" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.043672] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-52883b1a-74af-4f36-9cb4-1834015f09fe" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.043775] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('52883b1a-74af-4f36-9cb4-1834015f09fe',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.548117] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 52883b1a-74af-4f36-9cb4-1834015f09fe [ 690.548117] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.548234] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.548373] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.548675] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.548867] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.549037] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:52883b1a-74af-4f36-9cb4-1834015f09fe already deleted. [ 690.549202] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-52883b1a-74af-4f36-9cb4-1834015f09fe" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.123390] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b2d083bb-47e2-4637-be9f-9dbd7dc68026 in Status: SUCCESS [ 691.123624] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b2d083bb-47e2-4637-be9f-9dbd7dc68026" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.310242] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5afc8a2a-3bb1-4c3e-a10b-0941514929b4 in Status: SUCCESS [ 691.310361] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5afc8a2a-3bb1-4c3e-a10b-0941514929b4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.310577] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5afc8a2a-3bb1-4c3e-a10b-0941514929b4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.311693] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5afc8a2a-3bb1-4c3e-a10b-0941514929b4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.312678] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.312678] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.312678] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.312678] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.312678] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.312678] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5afc8a2a-3bb1-4c3e-a10b-0941514929b4',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.820328] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5afc8a2a-3bb1-4c3e-a10b-0941514929b4',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.286910] env[65337]: INFO networking_nsxv3.common.synchronization [None req-a0769e9a-f328-41d5-b266-33c2cbb71071 None None] Enqueued Resource ID: 95a58aeb-468c-4d32-b438-63485046ef4e with Priority: HIGHEST for action port [ 692.287756] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95a58aeb-468c-4d32-b438-63485046ef4e with Priority: HIGHEST for action port [ 692.288177] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-95a58aeb-468c-4d32-b438-63485046ef4e taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.288317] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-95a58aeb-468c-4d32-b438-63485046ef4e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.288395] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-95a58aeb-468c-4d32-b438-63485046ef4e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.288676] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-95a58aeb-468c-4d32-b438-63485046ef4e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.288819] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('95a58aeb-468c-4d32-b438-63485046ef4e',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.319328] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5afc8a2a-3bb1-4c3e-a10b-0941514929b4',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.791106] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 95a58aeb-468c-4d32-b438-63485046ef4e [ 692.794681] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.794847] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.795222] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.795755] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.796445] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.796567] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:95a58aeb-468c-4d32-b438-63485046ef4e already deleted. [ 692.796652] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-95a58aeb-468c-4d32-b438-63485046ef4e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.825155] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.825349] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.825390] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.825749] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.825846] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.825944] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5afc8a2a-3bb1-4c3e-a10b-0941514929b4 is going to be updated. [ 692.865034] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.865204] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.865275] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.865486] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.865631] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.882040] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5afc8a2a-3bb1-4c3e-a10b-0941514929b4 in Status: IN_PROGRESS for 2s [ 693.446491] env[65337]: INFO networking_nsxv3.common.synchronization [None req-1fbfd8b0-a153-400f-b25e-6baa2e3c1e92 None None] Enqueued Resource ID: ae562bd1-dadf-4c81-8a68-599dfb4b1bb7 with Priority: HIGHEST for action port [ 693.446883] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae562bd1-dadf-4c81-8a68-599dfb4b1bb7 with Priority: HIGHEST for action port [ 693.449276] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-ae562bd1-dadf-4c81-8a68-599dfb4b1bb7 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.449494] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ae562bd1-dadf-4c81-8a68-599dfb4b1bb7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.449615] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ae562bd1-dadf-4c81-8a68-599dfb4b1bb7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.449999] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ae562bd1-dadf-4c81-8a68-599dfb4b1bb7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.450201] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ae562bd1-dadf-4c81-8a68-599dfb4b1bb7',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.954974] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ae562bd1-dadf-4c81-8a68-599dfb4b1bb7 [ 693.954974] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.954974] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.954974] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.954974] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.954974] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.955400] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ae562bd1-dadf-4c81-8a68-599dfb4b1bb7 already deleted. [ 693.955400] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ae562bd1-dadf-4c81-8a68-599dfb4b1bb7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.090169] env[65337]: INFO networking_nsxv3.common.synchronization [req-4ee134a8-ec18-452c-b041-547a093a7182 req-838867f6-10a0-42fd-9b8e-727a26d9460e tempest-ServerActionsTestOtherA-84911055 tempest-ServerActionsTestOtherA-84911055-project-member] Enqueued Resource ID: a4a9546d-8cbc-404d-acef-d7856f353fbe with Priority: HIGHEST for action security_group_members [ 694.091358] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4a9546d-8cbc-404d-acef-d7856f353fbe with Priority: HIGHEST for action security_group_members [ 694.091358] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4a9546d-8cbc-404d-acef-d7856f353fbe taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.091358] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4a9546d-8cbc-404d-acef-d7856f353fbe" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.091776] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4a9546d-8cbc-404d-acef-d7856f353fbe" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.094455] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4a9546d-8cbc-404d-acef-d7856f353fbe" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.094455] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.094455] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.094455] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.094455] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.094455] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.094455] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a4a9546d-8cbc-404d-acef-d7856f353fbe',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.595862] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.598638] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.598638] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.598638] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.598638] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.598638] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.598638] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.598638] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.598638] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.598638] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.598638] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4a9546d-8cbc-404d-acef-d7856f353fbe already deleted. [ 694.598638] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4a9546d-8cbc-404d-acef-d7856f353fbe" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.628496] env[65337]: INFO networking_nsxv3.common.synchronization [req-0335342e-a984-42e8-9d49-de49b5e20f1b req-7d37d0fc-708a-458f-b89c-e478e0e71d19 tempest-VolumesAssistedSnapshotsTest-855556220 tempest-VolumesAssistedSnapshotsTest-855556220-project-member] Enqueued Resource ID: 1063e362-e6bc-4ee7-8518-83d8fe445cb4 with Priority: HIGHEST for action security_group_members [ 694.629132] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1063e362-e6bc-4ee7-8518-83d8fe445cb4 with Priority: HIGHEST for action security_group_members [ 694.629400] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-1063e362-e6bc-4ee7-8518-83d8fe445cb4 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.629523] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1063e362-e6bc-4ee7-8518-83d8fe445cb4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.629589] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1063e362-e6bc-4ee7-8518-83d8fe445cb4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.629794] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1063e362-e6bc-4ee7-8518-83d8fe445cb4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.629946] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.630698] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.630802] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.630996] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.631180] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.631307] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1063e362-e6bc-4ee7-8518-83d8fe445cb4',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.651699] env[65337]: INFO networking_nsxv3.common.synchronization [None req-0aa12454-ca19-4701-9036-d3d0485ac5ac None None] Enqueued Resource ID: 87866be4-af5f-4647-8f92-fe198e82a80c with Priority: HIGHEST for action port [ 694.651699] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87866be4-af5f-4647-8f92-fe198e82a80c with Priority: HIGHEST for action port [ 694.651699] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-87866be4-af5f-4647-8f92-fe198e82a80c taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.652163] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-87866be4-af5f-4647-8f92-fe198e82a80c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.652722] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-87866be4-af5f-4647-8f92-fe198e82a80c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.652722] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-87866be4-af5f-4647-8f92-fe198e82a80c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.652722] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('87866be4-af5f-4647-8f92-fe198e82a80c',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.839726] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock network-393 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.839917] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "network-393" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.840022] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "network-393" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.840851] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "network-393" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.840851] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.840851] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.841089] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.841243] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.841455] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.842504] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 694.842759] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 694.842759] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 694.842905] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 694.843049] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 694.843138] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 694.843290] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 694.864915] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 694.865161] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 694.865257] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 694.865438] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "network-393" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.865805] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock port-689e4934-83f0-4d26-a1b3-d5e7708cc0b8 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.866014] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "port-689e4934-83f0-4d26-a1b3-d5e7708cc0b8" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.866149] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "port-689e4934-83f0-4d26-a1b3-d5e7708cc0b8" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.867095] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "port-689e4934-83f0-4d26-a1b3-d5e7708cc0b8" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.867095] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('689e4934-83f0-4d26-a1b3-d5e7708cc0b8',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.896900] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5afc8a2a-3bb1-4c3e-a10b-0941514929b4 in Status: SUCCESS [ 694.896900] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5afc8a2a-3bb1-4c3e-a10b-0941514929b4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.896900] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5afc8a2a-3bb1-4c3e-a10b-0941514929b4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.896900] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5afc8a2a-3bb1-4c3e-a10b-0941514929b4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.896900] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.896900] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.896900] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.896900] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.896900] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.896900] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5afc8a2a-3bb1-4c3e-a10b-0941514929b4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.896900] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5afc8a2a-3bb1-4c3e-a10b-0941514929b4',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.134025] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.134248] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.134335] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.134582] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.134684] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.134911] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.135058] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.135144] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.135338] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.135430] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.135522] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1063e362-e6bc-4ee7-8518-83d8fe445cb4 is going to be updated. [ 695.142599] env[65337]: INFO networking_nsxv3.common.synchronization [None req-6a2d119b-38b7-4508-b3fb-42f80f553317 None None] Enqueued Resource ID: dc6ef3e0-1d2d-4d52-b84a-617b6e0da9e7 with Priority: HIGHEST for action port [ 695.143640] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc6ef3e0-1d2d-4d52-b84a-617b6e0da9e7 with Priority: HIGHEST for action port [ 695.144208] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-dc6ef3e0-1d2d-4d52-b84a-617b6e0da9e7 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.144323] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dc6ef3e0-1d2d-4d52-b84a-617b6e0da9e7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.144418] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dc6ef3e0-1d2d-4d52-b84a-617b6e0da9e7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.146212] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dc6ef3e0-1d2d-4d52-b84a-617b6e0da9e7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.146694] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dc6ef3e0-1d2d-4d52-b84a-617b6e0da9e7',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.155948] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 87866be4-af5f-4647-8f92-fe198e82a80c [ 695.156280] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.159393] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.159393] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.159393] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.159393] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.159393] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:87866be4-af5f-4647-8f92-fe198e82a80c already deleted. [ 695.159393] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-87866be4-af5f-4647-8f92-fe198e82a80c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.176666] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.180607] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.180607] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.180607] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.180607] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.191054] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1063e362-e6bc-4ee7-8518-83d8fe445cb4 in Status: IN_PROGRESS for 2s [ 695.370354] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.370749] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.371678] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.371678] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.371678] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.371678] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Segment Port 689e4934-83f0-4d26-a1b3-d5e7708cc0b8 not found, creating... [ 695.372103] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.372295] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.372943] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.372943] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.373415] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.373691] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.373924] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.374112] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.374413] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.374565] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.374734] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Resource: SegmentPort with ID: 689e4934-83f0-4d26-a1b3-d5e7708cc0b8 is going to be created. [ 695.401033] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5afc8a2a-3bb1-4c3e-a10b-0941514929b4',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.529911] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.530220] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.530300] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.531038] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.531038] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.531173] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "port-689e4934-83f0-4d26-a1b3-d5e7708cc0b8" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.586230] env[65337]: INFO networking_nsxv3.common.synchronization [req-63a55301-4f96-471d-9d16-2afecdde0262 req-13140fcf-41b9-4b0a-9b8b-d879eb8961e6 tempest-ServersAdminTestJSON-283641549 tempest-ServersAdminTestJSON-283641549-project-member] Enqueued Resource ID: 9e889ce7-965a-4de0-b096-60d4e743cf8b with Priority: HIGHEST for action security_group_members [ 695.586947] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e889ce7-965a-4de0-b096-60d4e743cf8b with Priority: HIGHEST for action security_group_members [ 695.587432] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e889ce7-965a-4de0-b096-60d4e743cf8b taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.587581] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.587660] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.588855] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.588855] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.588855] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.588855] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.588855] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.588855] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.588855] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e889ce7-965a-4de0-b096-60d4e743cf8b',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.653144] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dc6ef3e0-1d2d-4d52-b84a-617b6e0da9e7 [ 695.653559] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.653823] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.653823] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.654114] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.654200] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.654304] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dc6ef3e0-1d2d-4d52-b84a-617b6e0da9e7 already deleted. [ 695.654382] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dc6ef3e0-1d2d-4d52-b84a-617b6e0da9e7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.904418] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5afc8a2a-3bb1-4c3e-a10b-0941514929b4: rpc.has_security_group_logging(os_id): False [ 695.932146] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.933255] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.933255] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.933255] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.933255] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.933255] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.933614] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.933614] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.933614] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.934091] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.934223] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5afc8a2a-3bb1-4c3e-a10b-0941514929b4 is going to be updated. [ 696.036908] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.036908] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.036908] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.036908] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.036908] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.056050] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5afc8a2a-3bb1-4c3e-a10b-0941514929b4 in Status: IN_PROGRESS for 2s [ 696.091971] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9e889ce7-965a-4de0-b096-60d4e743cf8b',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.204548] env[65337]: INFO networking_nsxv3.common.synchronization [req-4ee134a8-ec18-452c-b041-547a093a7182 req-1b9306d7-3a8a-4120-9c24-ee163735e9eb service nova] Enqueued Resource ID: a4a9546d-8cbc-404d-acef-d7856f353fbe with Priority: HIGHEST for action security_group_rules [ 696.204777] env[65337]: INFO networking_nsxv3.common.synchronization [req-4ee134a8-ec18-452c-b041-547a093a7182 req-1b9306d7-3a8a-4120-9c24-ee163735e9eb service nova] Enqueued Resource ID: a4a9546d-8cbc-404d-acef-d7856f353fbe with Priority: HIGHEST for action security_group_members [ 696.204938] env[65337]: INFO networking_nsxv3.common.synchronization [req-4ee134a8-ec18-452c-b041-547a093a7182 req-1b9306d7-3a8a-4120-9c24-ee163735e9eb service nova] Enqueued Resource ID: 689e4934-83f0-4d26-a1b3-d5e7708cc0b8 with Priority: HIGHEST for action port [ 696.205569] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4a9546d-8cbc-404d-acef-d7856f353fbe with Priority: HIGHEST for action security_group_rules [ 696.206618] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4a9546d-8cbc-404d-acef-d7856f353fbe with Priority: HIGHEST for action security_group_members [ 696.206618] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 689e4934-83f0-4d26-a1b3-d5e7708cc0b8 with Priority: HIGHEST for action port [ 696.206618] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a4a9546d-8cbc-404d-acef-d7856f353fbe taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.206618] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a4a9546d-8cbc-404d-acef-d7856f353fbe" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.206618] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a4a9546d-8cbc-404d-acef-d7856f353fbe" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.206618] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a4a9546d-8cbc-404d-acef-d7856f353fbe" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.207096] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a4a9546d-8cbc-404d-acef-d7856f353fbe',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.207930] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4a9546d-8cbc-404d-acef-d7856f353fbe taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.208067] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4a9546d-8cbc-404d-acef-d7856f353fbe" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.208134] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4a9546d-8cbc-404d-acef-d7856f353fbe" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.208322] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4a9546d-8cbc-404d-acef-d7856f353fbe" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.208480] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.208582] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.208644] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.208787] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.208876] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.208972] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a4a9546d-8cbc-404d-acef-d7856f353fbe',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.209833] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-689e4934-83f0-4d26-a1b3-d5e7708cc0b8 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.209942] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-689e4934-83f0-4d26-a1b3-d5e7708cc0b8" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.210012] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-689e4934-83f0-4d26-a1b3-d5e7708cc0b8" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.210542] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-689e4934-83f0-4d26-a1b3-d5e7708cc0b8" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.210542] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('689e4934-83f0-4d26-a1b3-d5e7708cc0b8',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.595515] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9e889ce7-965a-4de0-b096-60d4e743cf8b',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.717175] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4a9546d-8cbc-404d-acef-d7856f353fbe taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.717612] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4a9546d-8cbc-404d-acef-d7856f353fbe" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.717803] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a4a9546d-8cbc-404d-acef-d7856f353fbe',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.719629] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 689e4934-83f0-4d26-a1b3-d5e7708cc0b8 with status ACTIVE [ 696.720248] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.720248] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.720248] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.721074] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.721074] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.721074] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.721074] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.721074] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.721309] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.721352] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.722067] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.722067] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.722067] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.722067] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.725304] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.725304] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 689e4934-83f0-4d26-a1b3-d5e7708cc0b8 is going to be updated. [ 696.748345] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.748544] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.748664] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.749163] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.749958] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.749958] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-689e4934-83f0-4d26-a1b3-d5e7708cc0b8" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.779066] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock network-366 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.779325] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "network-366" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.779512] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "network-366" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.779848] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "network-366" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.784040] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.784040] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.784040] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.784040] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.784325] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.784380] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 696.784550] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 696.784713] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 696.784876] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 696.785092] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 696.785227] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 696.785403] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 696.810190] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 696.810373] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 696.811559] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 696.811559] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "network-366" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.811559] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock port-2e35b0c5-b03d-4880-80fe-a9b46780ae57 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.811559] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "port-2e35b0c5-b03d-4880-80fe-a9b46780ae57" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.811895] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "port-2e35b0c5-b03d-4880-80fe-a9b46780ae57" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.812534] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "port-2e35b0c5-b03d-4880-80fe-a9b46780ae57" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.813168] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2e35b0c5-b03d-4880-80fe-a9b46780ae57',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.098994] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.099279] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.099279] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.099897] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.099897] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.099897] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e889ce7-965a-4de0-b096-60d4e743cf8b is going to be updated. [ 697.136954] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.137169] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.137215] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.137454] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.137661] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.149682] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e889ce7-965a-4de0-b096-60d4e743cf8b in Status: IN_PROGRESS for 2s [ 697.208023] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1063e362-e6bc-4ee7-8518-83d8fe445cb4 in Status: SUCCESS [ 697.208023] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1063e362-e6bc-4ee7-8518-83d8fe445cb4 deletion is rescheduled due to dependency. [ 697.208023] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1063e362-e6bc-4ee7-8518-83d8fe445cb4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.224929] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a4a9546d-8cbc-404d-acef-d7856f353fbe',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.315775] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.315958] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.316084] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.316880] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.316880] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.316880] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Segment Port 2e35b0c5-b03d-4880-80fe-a9b46780ae57 not found, creating... [ 697.321026] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.321026] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.321026] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.321026] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.321026] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.321026] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.321026] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.321026] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.321026] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.321026] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.321510] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Resource: SegmentPort with ID: 2e35b0c5-b03d-4880-80fe-a9b46780ae57 is going to be created. [ 697.345342] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.345647] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.345843] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.347091] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.347091] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.347091] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "port-2e35b0c5-b03d-4880-80fe-a9b46780ae57" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.726876] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.728626] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.728626] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.728626] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.728626] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.728814] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4a9546d-8cbc-404d-acef-d7856f353fbe is going to be created. [ 697.759363] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.759363] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.759363] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.759363] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.759363] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.769108] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4a9546d-8cbc-404d-acef-d7856f353fbe in Status: UNINITIALIZED for 2s [ 698.073263] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5afc8a2a-3bb1-4c3e-a10b-0941514929b4 in Status: SUCCESS [ 698.073263] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5afc8a2a-3bb1-4c3e-a10b-0941514929b4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.074971] env[65337]: INFO networking_nsxv3.common.synchronization [req-63a55301-4f96-471d-9d16-2afecdde0262 req-98f84d43-2fc2-464d-89a7-57fd80e4cb85 service nova] Enqueued Resource ID: 9e889ce7-965a-4de0-b096-60d4e743cf8b with Priority: HIGHEST for action security_group_rules [ 698.075232] env[65337]: INFO networking_nsxv3.common.synchronization [req-63a55301-4f96-471d-9d16-2afecdde0262 req-98f84d43-2fc2-464d-89a7-57fd80e4cb85 service nova] Enqueued Resource ID: 9e889ce7-965a-4de0-b096-60d4e743cf8b with Priority: HIGHEST for action security_group_members [ 698.075460] env[65337]: INFO networking_nsxv3.common.synchronization [req-63a55301-4f96-471d-9d16-2afecdde0262 req-98f84d43-2fc2-464d-89a7-57fd80e4cb85 service nova] Enqueued Resource ID: 2e35b0c5-b03d-4880-80fe-a9b46780ae57 with Priority: HIGHEST for action port [ 698.076425] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e889ce7-965a-4de0-b096-60d4e743cf8b with Priority: HIGHEST for action security_group_rules [ 698.076599] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e889ce7-965a-4de0-b096-60d4e743cf8b with Priority: HIGHEST for action security_group_members [ 698.076725] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e35b0c5-b03d-4880-80fe-a9b46780ae57 with Priority: HIGHEST for action port [ 698.077043] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9e889ce7-965a-4de0-b096-60d4e743cf8b taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.077257] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.077294] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.077503] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.077603] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9e889ce7-965a-4de0-b096-60d4e743cf8b',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.078562] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e889ce7-965a-4de0-b096-60d4e743cf8b taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.078703] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.078917] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-2e35b0c5-b03d-4880-80fe-a9b46780ae57 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.079055] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2e35b0c5-b03d-4880-80fe-a9b46780ae57" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.079139] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2e35b0c5-b03d-4880-80fe-a9b46780ae57" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.079342] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2e35b0c5-b03d-4880-80fe-a9b46780ae57" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.079603] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2e35b0c5-b03d-4880-80fe-a9b46780ae57',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.190831] env[65337]: INFO networking_nsxv3.common.synchronization [req-e91a7842-295f-4542-927a-8d24bd2df806 req-d21d4baa-c4e1-4ec2-846b-aead3165ca08 tempest-AttachInterfacesUnderV243Test-1010804015 tempest-AttachInterfacesUnderV243Test-1010804015-project-member] Enqueued Resource ID: 5afc8a2a-3bb1-4c3e-a10b-0941514929b4 with Priority: HIGHEST for action security_group_members [ 698.191577] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5afc8a2a-3bb1-4c3e-a10b-0941514929b4 with Priority: HIGHEST for action security_group_members [ 698.191966] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-5afc8a2a-3bb1-4c3e-a10b-0941514929b4 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.192907] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5afc8a2a-3bb1-4c3e-a10b-0941514929b4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.192907] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5afc8a2a-3bb1-4c3e-a10b-0941514929b4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.192907] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5afc8a2a-3bb1-4c3e-a10b-0941514929b4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.192907] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.193083] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.193083] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.193238] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.193342] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.193440] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5afc8a2a-3bb1-4c3e-a10b-0941514929b4',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.581980] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e889ce7-965a-4de0-b096-60d4e743cf8b taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.582199] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.582455] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2e35b0c5-b03d-4880-80fe-a9b46780ae57 with status ACTIVE [ 698.582671] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.582784] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.582860] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.583212] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.583212] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.583366] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.583412] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.583447] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.584140] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.584140] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.584140] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.584140] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.584140] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.584140] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.585675] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.585675] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2e35b0c5-b03d-4880-80fe-a9b46780ae57 is going to be updated. [ 698.608532] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.608709] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.608709] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.609490] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.610225] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.610328] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2e35b0c5-b03d-4880-80fe-a9b46780ae57" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.698108] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.698361] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.698471] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.698773] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.698940] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.699328] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.699474] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.699581] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.699854] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.700049] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.700178] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5afc8a2a-3bb1-4c3e-a10b-0941514929b4 is going to be updated. [ 698.754981] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.754981] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.754981] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.755477] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.755477] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.776533] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5afc8a2a-3bb1-4c3e-a10b-0941514929b4 in Status: IN_PROGRESS for 2s [ 698.839580] env[65337]: INFO networking_nsxv3.common.synchronization [None req-3311bb30-af82-45c2-8e9d-365d15d1517b None None] Enqueued Resource ID: 58310b34-6ece-4117-8d7e-d9d0e8b256f5 with Priority: HIGHEST for action port [ 698.840336] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58310b34-6ece-4117-8d7e-d9d0e8b256f5 with Priority: HIGHEST for action port [ 698.840764] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-58310b34-6ece-4117-8d7e-d9d0e8b256f5 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.841032] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-58310b34-6ece-4117-8d7e-d9d0e8b256f5" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.841193] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-58310b34-6ece-4117-8d7e-d9d0e8b256f5" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.841539] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-58310b34-6ece-4117-8d7e-d9d0e8b256f5" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.841760] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('58310b34-6ece-4117-8d7e-d9d0e8b256f5',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.001926] env[65337]: INFO networking_nsxv3.common.synchronization [req-f9aa608c-0302-4c21-8d15-832107d19af6 req-74cc4ada-54da-4fe6-acc4-2b303341d194 tempest-SecurityGroupsTestJSON-920822125 tempest-SecurityGroupsTestJSON-920822125-project-member] Enqueued Resource ID: 755f030a-6e7c-43ec-adb9-cb4c270ad532 with Priority: HIGHEST for action security_group_members [ 699.002873] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 755f030a-6e7c-43ec-adb9-cb4c270ad532 with Priority: HIGHEST for action security_group_members [ 699.003818] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-755f030a-6e7c-43ec-adb9-cb4c270ad532 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.005825] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.005825] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.005825] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.005825] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.005825] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.005825] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.006156] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.007584] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.007584] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('755f030a-6e7c-43ec-adb9-cb4c270ad532',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.164784] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e889ce7-965a-4de0-b096-60d4e743cf8b in Status: SUCCESS [ 699.164784] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.164784] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.164784] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.164784] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.164784] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.164784] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.164784] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.164784] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.164784] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e889ce7-965a-4de0-b096-60d4e743cf8b',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.345365] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 58310b34-6ece-4117-8d7e-d9d0e8b256f5 [ 699.345365] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.345365] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.345365] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.345365] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.345365] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.345365] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:58310b34-6ece-4117-8d7e-d9d0e8b256f5 already deleted. [ 699.345365] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-58310b34-6ece-4117-8d7e-d9d0e8b256f5" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.514708] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.514882] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.514952] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.515220] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.515386] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.515551] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.515826] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.515826] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.515919] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.515919] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.515997] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 755f030a-6e7c-43ec-adb9-cb4c270ad532 already deleted. [ 699.516084] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.654547] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock network-525 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.654867] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "network-525" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.654867] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "network-525" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.656025] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "network-525" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.656387] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.656581] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.656697] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.656940] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.657130] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.657358] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 699.657466] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 699.657572] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 699.657672] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 699.657772] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 699.657869] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 699.658021] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 699.669661] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9e889ce7-965a-4de0-b096-60d4e743cf8b',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.678680] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 699.678680] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 699.678680] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 699.678834] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "network-525" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.679119] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock port-71ec9dc6-358b-4444-9c85-6c8f2b7819e5 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.679285] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "port-71ec9dc6-358b-4444-9c85-6c8f2b7819e5" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.679791] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "port-71ec9dc6-358b-4444-9c85-6c8f2b7819e5" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.679791] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "port-71ec9dc6-358b-4444-9c85-6c8f2b7819e5" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.679863] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('71ec9dc6-358b-4444-9c85-6c8f2b7819e5',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.780222] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4a9546d-8cbc-404d-acef-d7856f353fbe in Status: SUCCESS [ 699.780481] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4a9546d-8cbc-404d-acef-d7856f353fbe" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.780748] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4a9546d-8cbc-404d-acef-d7856f353fbe" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.781036] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4a9546d-8cbc-404d-acef-d7856f353fbe" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.781315] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.781465] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.781546] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.781770] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.781929] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.782033] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4a9546d-8cbc-404d-acef-d7856f353fbe" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.782175] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a4a9546d-8cbc-404d-acef-d7856f353fbe',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.174428] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9e889ce7-965a-4de0-b096-60d4e743cf8b',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.185782] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.185984] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.186142] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.186566] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.186810] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.187013] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Segment Port 71ec9dc6-358b-4444-9c85-6c8f2b7819e5 not found, creating... [ 700.187681] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.187681] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.187681] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.187895] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.188167] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.188453] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.188952] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.189100] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.189386] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.189694] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.189694] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Resource: SegmentPort with ID: 71ec9dc6-358b-4444-9c85-6c8f2b7819e5 is going to be created. [ 700.214347] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.214611] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.214776] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.215129] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.215441] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.215740] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "port-71ec9dc6-358b-4444-9c85-6c8f2b7819e5" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.285000] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a4a9546d-8cbc-404d-acef-d7856f353fbe',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.677078] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.680726] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.680726] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.680726] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.680726] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.680726] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e889ce7-965a-4de0-b096-60d4e743cf8b is going to be updated. [ 700.712945] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.712945] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.712945] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.712945] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.712945] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.722403] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e889ce7-965a-4de0-b096-60d4e743cf8b in Status: IN_PROGRESS for 2s [ 700.786946] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5afc8a2a-3bb1-4c3e-a10b-0941514929b4 in Status: SUCCESS [ 700.789391] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5afc8a2a-3bb1-4c3e-a10b-0941514929b4 deletion is rescheduled due to dependency. [ 700.789391] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5afc8a2a-3bb1-4c3e-a10b-0941514929b4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.789766] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a4a9546d-8cbc-404d-acef-d7856f353fbe: rpc.has_security_group_logging(os_id): False [ 700.809635] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.809801] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.809839] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.810155] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.810297] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.810599] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.810778] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.810869] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.811222] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.811372] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.811541] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a4a9546d-8cbc-404d-acef-d7856f353fbe is going to be created. [ 700.877165] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.877359] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.877410] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.877643] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.877874] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.893784] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a4a9546d-8cbc-404d-acef-d7856f353fbe in Status: IN_PROGRESS for 2s [ 701.048647] env[65337]: INFO networking_nsxv3.common.synchronization [req-f9aa608c-0302-4c21-8d15-832107d19af6 req-78aeccc3-cab1-4c4d-b5e1-21f219a09465 service nova] Enqueued Resource ID: 755f030a-6e7c-43ec-adb9-cb4c270ad532 with Priority: HIGHEST for action security_group_rules [ 701.048864] env[65337]: INFO networking_nsxv3.common.synchronization [req-f9aa608c-0302-4c21-8d15-832107d19af6 req-78aeccc3-cab1-4c4d-b5e1-21f219a09465 service nova] Enqueued Resource ID: 755f030a-6e7c-43ec-adb9-cb4c270ad532 with Priority: HIGHEST for action security_group_members [ 701.049032] env[65337]: INFO networking_nsxv3.common.synchronization [req-f9aa608c-0302-4c21-8d15-832107d19af6 req-78aeccc3-cab1-4c4d-b5e1-21f219a09465 service nova] Enqueued Resource ID: 71ec9dc6-358b-4444-9c85-6c8f2b7819e5 with Priority: HIGHEST for action port [ 701.049615] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 755f030a-6e7c-43ec-adb9-cb4c270ad532 with Priority: HIGHEST for action security_group_rules [ 701.049755] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 755f030a-6e7c-43ec-adb9-cb4c270ad532 with Priority: HIGHEST for action security_group_members [ 701.049861] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71ec9dc6-358b-4444-9c85-6c8f2b7819e5 with Priority: HIGHEST for action port [ 701.050363] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-755f030a-6e7c-43ec-adb9-cb4c270ad532 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.050558] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.050655] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.050980] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.051142] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('755f030a-6e7c-43ec-adb9-cb4c270ad532',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.052220] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-755f030a-6e7c-43ec-adb9-cb4c270ad532 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.052551] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.052794] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.053033] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.053231] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.053367] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.053487] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.053679] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.053812] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.053996] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('755f030a-6e7c-43ec-adb9-cb4c270ad532',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.056243] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-71ec9dc6-358b-4444-9c85-6c8f2b7819e5 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.056243] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-71ec9dc6-358b-4444-9c85-6c8f2b7819e5" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.056243] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-71ec9dc6-358b-4444-9c85-6c8f2b7819e5" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.056243] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-71ec9dc6-358b-4444-9c85-6c8f2b7819e5" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.056243] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('71ec9dc6-358b-4444-9c85-6c8f2b7819e5',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.558734] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-755f030a-6e7c-43ec-adb9-cb4c270ad532 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.558734] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.562051] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('755f030a-6e7c-43ec-adb9-cb4c270ad532',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.562051] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 71ec9dc6-358b-4444-9c85-6c8f2b7819e5 with status ACTIVE [ 701.562051] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.562051] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.562051] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.562051] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.562051] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.562051] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.562051] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.562051] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.562051] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.562051] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.562051] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.562051] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.562051] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.563384] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.563609] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.564015] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 71ec9dc6-358b-4444-9c85-6c8f2b7819e5 is going to be updated. [ 701.593461] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.593461] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.593461] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.593461] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.593461] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.593461] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-71ec9dc6-358b-4444-9c85-6c8f2b7819e5" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.608067] env[65337]: INFO networking_nsxv3.common.synchronization [req-e5571daa-1ac0-4311-b38e-cdd1a1913ce9 req-339e7113-00ec-435f-9650-1e69770059ed tempest-AttachInterfacesTestJSON-1783062477 tempest-AttachInterfacesTestJSON-1783062477-project-member] Enqueued Resource ID: ee03c436-a01f-49f3-9012-42ca1b72c1d4 with Priority: HIGHEST for action security_group_members [ 701.609728] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee03c436-a01f-49f3-9012-42ca1b72c1d4 with Priority: HIGHEST for action security_group_members [ 701.611323] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee03c436-a01f-49f3-9012-42ca1b72c1d4 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.612045] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee03c436-a01f-49f3-9012-42ca1b72c1d4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.612984] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee03c436-a01f-49f3-9012-42ca1b72c1d4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.612984] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee03c436-a01f-49f3-9012-42ca1b72c1d4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.613605] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.614059] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.614790] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.614790] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.614790] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.614790] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ee03c436-a01f-49f3-9012-42ca1b72c1d4',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.069456] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('755f030a-6e7c-43ec-adb9-cb4c270ad532',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.118109] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.118573] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.118573] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.118739] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.118835] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.119020] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.119173] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.119256] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.119418] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.119585] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.119585] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee03c436-a01f-49f3-9012-42ca1b72c1d4 already deleted. [ 702.119678] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee03c436-a01f-49f3-9012-42ca1b72c1d4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.223880] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock network-250 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.224138] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "network-250" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.224284] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "network-250" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.224684] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "network-250" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.224957] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.225156] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.225276] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.225498] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.225643] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.225846] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 702.225989] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 702.226157] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 702.226393] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 702.226530] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 702.226649] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 702.226785] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 702.249562] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 702.249790] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 702.249863] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 702.250046] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "network-250" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.250370] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock port-63c18048-c095-48a2-a50c-fc1e68c78878 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.250530] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "port-63c18048-c095-48a2-a50c-fc1e68c78878" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.250642] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "port-63c18048-c095-48a2-a50c-fc1e68c78878" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.251366] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "port-63c18048-c095-48a2-a50c-fc1e68c78878" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.251486] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('63c18048-c095-48a2-a50c-fc1e68c78878',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.575278] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.575460] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.575504] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.575752] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.575846] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.575947] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 755f030a-6e7c-43ec-adb9-cb4c270ad532 is going to be created. [ 702.601432] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.601936] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.601936] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.602092] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.602258] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.616053] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 755f030a-6e7c-43ec-adb9-cb4c270ad532 in Status: UNINITIALIZED for 2s [ 702.734047] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e889ce7-965a-4de0-b096-60d4e743cf8b in Status: SUCCESS [ 702.734352] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.734599] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.734883] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.735198] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.735385] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.735483] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.735669] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.735763] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.735886] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.735987] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9e889ce7-965a-4de0-b096-60d4e743cf8b',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.755404] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.755670] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.755721] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.756079] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.756244] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.756446] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Segment Port 63c18048-c095-48a2-a50c-fc1e68c78878 not found, creating... [ 702.756813] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.757046] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.757214] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.757535] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.757738] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.758192] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.758429] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.758616] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.758911] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.759139] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.759366] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Resource: SegmentPort with ID: 63c18048-c095-48a2-a50c-fc1e68c78878 is going to be created. [ 702.783185] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.783506] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.783651] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.784011] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.784266] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.784502] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "port-63c18048-c095-48a2-a50c-fc1e68c78878" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.904320] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a4a9546d-8cbc-404d-acef-d7856f353fbe in Status: SUCCESS [ 702.904640] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a4a9546d-8cbc-404d-acef-d7856f353fbe" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.239666] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e889ce7-965a-4de0-b096-60d4e743cf8b taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.239998] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.239998] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.240417] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.241140] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.241140] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.241140] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.241140] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.241140] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.241326] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.241526] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e889ce7-965a-4de0-b096-60d4e743cf8b taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.243037] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.243037] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.243037] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.243037] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.243037] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.243037] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.243037] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.243037] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.243037] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.243037] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9e889ce7-965a-4de0-b096-60d4e743cf8b',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.588898] env[65337]: INFO networking_nsxv3.common.synchronization [req-e5571daa-1ac0-4311-b38e-cdd1a1913ce9 req-2849efcd-7852-44aa-9e93-0c2f32cbd9e9 service nova] Enqueued Resource ID: ee03c436-a01f-49f3-9012-42ca1b72c1d4 with Priority: HIGHEST for action security_group_rules [ 703.588898] env[65337]: INFO networking_nsxv3.common.synchronization [req-e5571daa-1ac0-4311-b38e-cdd1a1913ce9 req-2849efcd-7852-44aa-9e93-0c2f32cbd9e9 service nova] Enqueued Resource ID: ee03c436-a01f-49f3-9012-42ca1b72c1d4 with Priority: HIGHEST for action security_group_members [ 703.588898] env[65337]: INFO networking_nsxv3.common.synchronization [req-e5571daa-1ac0-4311-b38e-cdd1a1913ce9 req-2849efcd-7852-44aa-9e93-0c2f32cbd9e9 service nova] Enqueued Resource ID: 63c18048-c095-48a2-a50c-fc1e68c78878 with Priority: HIGHEST for action port [ 703.588898] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee03c436-a01f-49f3-9012-42ca1b72c1d4 with Priority: HIGHEST for action security_group_rules [ 703.588898] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee03c436-a01f-49f3-9012-42ca1b72c1d4 with Priority: HIGHEST for action security_group_members [ 703.588898] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63c18048-c095-48a2-a50c-fc1e68c78878 with Priority: HIGHEST for action port [ 703.588898] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ee03c436-a01f-49f3-9012-42ca1b72c1d4 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.588898] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ee03c436-a01f-49f3-9012-42ca1b72c1d4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.588898] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ee03c436-a01f-49f3-9012-42ca1b72c1d4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.590025] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ee03c436-a01f-49f3-9012-42ca1b72c1d4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.590132] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ee03c436-a01f-49f3-9012-42ca1b72c1d4',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.591153] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee03c436-a01f-49f3-9012-42ca1b72c1d4 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.591275] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee03c436-a01f-49f3-9012-42ca1b72c1d4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.591344] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee03c436-a01f-49f3-9012-42ca1b72c1d4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.591582] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee03c436-a01f-49f3-9012-42ca1b72c1d4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.591832] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.591963] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.592078] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.592284] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.592392] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.592484] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ee03c436-a01f-49f3-9012-42ca1b72c1d4',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.596391] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-63c18048-c095-48a2-a50c-fc1e68c78878 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.597341] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-63c18048-c095-48a2-a50c-fc1e68c78878" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.597341] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-63c18048-c095-48a2-a50c-fc1e68c78878" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.597341] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-63c18048-c095-48a2-a50c-fc1e68c78878" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.597341] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('63c18048-c095-48a2-a50c-fc1e68c78878',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.748451] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9e889ce7-965a-4de0-b096-60d4e743cf8b: rpc.has_security_group_logging(os_id): False [ 703.775691] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.775933] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.776450] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.776450] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.776626] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.776913] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.778145] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.778283] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.779179] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.779179] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.780092] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.780284] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.780389] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.780670] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.780835] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.781351] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.781452] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.781503] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.781776] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.781929] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.784138] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9e889ce7-965a-4de0-b096-60d4e743cf8b is going to be updated. [ 703.872513] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.872702] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.872744] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.873235] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.873235] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.895255] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9e889ce7-965a-4de0-b096-60d4e743cf8b in Status: IN_PROGRESS for 2s [ 704.098995] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee03c436-a01f-49f3-9012-42ca1b72c1d4 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.099238] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee03c436-a01f-49f3-9012-42ca1b72c1d4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.100090] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ee03c436-a01f-49f3-9012-42ca1b72c1d4',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.103345] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 63c18048-c095-48a2-a50c-fc1e68c78878 with status ACTIVE [ 704.103722] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.103722] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.103855] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.104349] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.104472] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.104700] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.104850] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.104888] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.105231] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.105335] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.105802] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.105948] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.106026] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.106267] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.106328] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.106361] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 63c18048-c095-48a2-a50c-fc1e68c78878 is going to be updated. [ 704.139223] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.139401] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.139472] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.139648] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.139859] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.139929] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-63c18048-c095-48a2-a50c-fc1e68c78878" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.611943] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ee03c436-a01f-49f3-9012-42ca1b72c1d4',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.627915] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 755f030a-6e7c-43ec-adb9-cb4c270ad532 in Status: SUCCESS [ 704.628128] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.628662] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.630164] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.630164] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.630164] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.630164] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.630164] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.630164] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.630164] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.630164] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('755f030a-6e7c-43ec-adb9-cb4c270ad532',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.116500] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.116665] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.116732] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.116951] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.117060] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.117169] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee03c436-a01f-49f3-9012-42ca1b72c1d4 is going to be created. [ 705.135613] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-755f030a-6e7c-43ec-adb9-cb4c270ad532 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.135860] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.135979] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.136431] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.136709] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.137133] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.137133] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.137268] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.137410] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.137591] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.137978] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-755f030a-6e7c-43ec-adb9-cb4c270ad532 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.138817] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.138817] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.138817] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.138817] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.138817] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.138817] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.138817] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.138817] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.139094] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.139094] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('755f030a-6e7c-43ec-adb9-cb4c270ad532',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.150701] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.150701] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.151085] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.151085] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.151296] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.166790] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee03c436-a01f-49f3-9012-42ca1b72c1d4 in Status: UNINITIALIZED for 2s [ 705.641557] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 755f030a-6e7c-43ec-adb9-cb4c270ad532: rpc.has_security_group_logging(os_id): False [ 705.664763] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.664763] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.664763] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.666045] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.666045] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.666045] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.666045] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.666045] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.666303] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.666303] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.666877] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.666877] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.666951] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.667221] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.667221] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.667373] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.667457] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.667520] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.667694] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.667777] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.667863] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 755f030a-6e7c-43ec-adb9-cb4c270ad532 is going to be created. [ 705.741239] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.741239] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.741239] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.741599] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.741760] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.758721] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 755f030a-6e7c-43ec-adb9-cb4c270ad532 in Status: IN_PROGRESS for 2s [ 705.791427] env[65337]: INFO networking_nsxv3.common.synchronization [None req-9afc3d11-cbba-4b52-8ab7-d552e1f8f56c None None] Enqueued Resource ID: 1905fa70-1589-4cd2-aa51-0b1bd11c4d1e with Priority: HIGHEST for action port [ 705.792284] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1905fa70-1589-4cd2-aa51-0b1bd11c4d1e with Priority: HIGHEST for action port [ 705.792650] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-1905fa70-1589-4cd2-aa51-0b1bd11c4d1e taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.792832] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1905fa70-1589-4cd2-aa51-0b1bd11c4d1e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.792912] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1905fa70-1589-4cd2-aa51-0b1bd11c4d1e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.793223] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1905fa70-1589-4cd2-aa51-0b1bd11c4d1e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.793326] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1905fa70-1589-4cd2-aa51-0b1bd11c4d1e',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.930824] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9e889ce7-965a-4de0-b096-60d4e743cf8b in Status: SUCCESS [ 705.931137] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.296687] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1905fa70-1589-4cd2-aa51-0b1bd11c4d1e [ 706.296954] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.297332] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.297332] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.297548] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.297658] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.297759] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1905fa70-1589-4cd2-aa51-0b1bd11c4d1e already deleted. [ 706.297835] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1905fa70-1589-4cd2-aa51-0b1bd11c4d1e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.935422] env[65337]: INFO networking_nsxv3.common.synchronization [req-2ae272ff-b842-48b0-9621-45a2e26d1b04 req-4c79cde3-2ebb-49dc-9a37-ad6c7aec0723 tempest-ServersAdminNegativeTestJSON-683436170 tempest-ServersAdminNegativeTestJSON-683436170-project-member] Enqueued Resource ID: d9afc808-3692-46b5-a84b-018d8d2b7f94 with Priority: HIGHEST for action security_group_members [ 706.937871] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9afc808-3692-46b5-a84b-018d8d2b7f94 with Priority: HIGHEST for action security_group_members [ 706.938417] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9afc808-3692-46b5-a84b-018d8d2b7f94 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.938417] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9afc808-3692-46b5-a84b-018d8d2b7f94" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.938583] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9afc808-3692-46b5-a84b-018d8d2b7f94" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.938744] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9afc808-3692-46b5-a84b-018d8d2b7f94" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.938905] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.939017] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.939305] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.939305] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.939305] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.939519] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d9afc808-3692-46b5-a84b-018d8d2b7f94',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.177128] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee03c436-a01f-49f3-9012-42ca1b72c1d4 in Status: SUCCESS [ 707.177440] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee03c436-a01f-49f3-9012-42ca1b72c1d4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.177589] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee03c436-a01f-49f3-9012-42ca1b72c1d4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.177765] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee03c436-a01f-49f3-9012-42ca1b72c1d4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.177956] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.178085] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.178148] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.178297] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.178380] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.178463] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee03c436-a01f-49f3-9012-42ca1b72c1d4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.178563] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ee03c436-a01f-49f3-9012-42ca1b72c1d4',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.337862] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock network-292 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.337862] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "network-292" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.337862] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "network-292" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.337862] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "network-292" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.337862] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.337862] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.337862] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.338424] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.338787] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.339208] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 707.339395] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 707.339542] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 707.339675] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 707.339815] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 707.339948] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 707.340151] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 707.363809] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 707.364052] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 707.364207] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 707.364378] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "network-292" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.364981] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock port-8515d9a8-a4ac-468f-8b0c-038d8d0a4e5c taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.364981] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "port-8515d9a8-a4ac-468f-8b0c-038d8d0a4e5c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.364981] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "port-8515d9a8-a4ac-468f-8b0c-038d8d0a4e5c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.365330] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "port-8515d9a8-a4ac-468f-8b0c-038d8d0a4e5c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.365465] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8515d9a8-a4ac-468f-8b0c-038d8d0a4e5c',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.442623] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.442818] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.442818] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.443297] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.443297] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.446028] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.446028] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.446028] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.446028] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.446028] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.446028] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d9afc808-3692-46b5-a84b-018d8d2b7f94 already deleted. [ 707.446028] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9afc808-3692-46b5-a84b-018d8d2b7f94" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.685232] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ee03c436-a01f-49f3-9012-42ca1b72c1d4',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.775953] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 755f030a-6e7c-43ec-adb9-cb4c270ad532 in Status: SUCCESS [ 707.776643] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.869034] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.869254] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.869254] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.870187] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.870187] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.870187] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Segment Port 8515d9a8-a4ac-468f-8b0c-038d8d0a4e5c not found, creating... [ 707.870187] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.870187] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.870437] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.870762] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.870762] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.870897] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.871062] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.871190] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.871368] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.871494] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.871628] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Resource: SegmentPort with ID: 8515d9a8-a4ac-468f-8b0c-038d8d0a4e5c is going to be created. [ 707.895750] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.896052] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.896140] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.896524] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.896726] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.896914] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "port-8515d9a8-a4ac-468f-8b0c-038d8d0a4e5c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.190374] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ee03c436-a01f-49f3-9012-42ca1b72c1d4: rpc.has_security_group_logging(os_id): False [ 708.209371] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.209559] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.209599] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.209785] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.209867] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.210118] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.210265] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.210265] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.210411] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.210486] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.210569] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ee03c436-a01f-49f3-9012-42ca1b72c1d4 is going to be created. [ 708.273423] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.274282] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.274282] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.274282] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.274456] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.301206] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ee03c436-a01f-49f3-9012-42ca1b72c1d4 in Status: IN_PROGRESS for 2s [ 708.622748] env[65337]: INFO networking_nsxv3.common.synchronization [req-2ae272ff-b842-48b0-9621-45a2e26d1b04 req-01100538-0bd9-46e8-9b7c-3eea41c72902 service nova] Enqueued Resource ID: d9afc808-3692-46b5-a84b-018d8d2b7f94 with Priority: HIGHEST for action security_group_rules [ 708.622898] env[65337]: INFO networking_nsxv3.common.synchronization [req-2ae272ff-b842-48b0-9621-45a2e26d1b04 req-01100538-0bd9-46e8-9b7c-3eea41c72902 service nova] Enqueued Resource ID: d9afc808-3692-46b5-a84b-018d8d2b7f94 with Priority: HIGHEST for action security_group_members [ 708.623056] env[65337]: INFO networking_nsxv3.common.synchronization [req-2ae272ff-b842-48b0-9621-45a2e26d1b04 req-01100538-0bd9-46e8-9b7c-3eea41c72902 service nova] Enqueued Resource ID: 8515d9a8-a4ac-468f-8b0c-038d8d0a4e5c with Priority: HIGHEST for action port [ 708.623773] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9afc808-3692-46b5-a84b-018d8d2b7f94 with Priority: HIGHEST for action security_group_rules [ 708.623977] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9afc808-3692-46b5-a84b-018d8d2b7f94 with Priority: HIGHEST for action security_group_members [ 708.624725] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8515d9a8-a4ac-468f-8b0c-038d8d0a4e5c with Priority: HIGHEST for action port [ 708.625104] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d9afc808-3692-46b5-a84b-018d8d2b7f94 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.625240] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d9afc808-3692-46b5-a84b-018d8d2b7f94" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.625309] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d9afc808-3692-46b5-a84b-018d8d2b7f94" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.625585] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d9afc808-3692-46b5-a84b-018d8d2b7f94" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.625674] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d9afc808-3692-46b5-a84b-018d8d2b7f94',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.627984] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9afc808-3692-46b5-a84b-018d8d2b7f94 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.627984] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9afc808-3692-46b5-a84b-018d8d2b7f94" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.627984] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9afc808-3692-46b5-a84b-018d8d2b7f94" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.627984] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9afc808-3692-46b5-a84b-018d8d2b7f94" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.627984] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.628522] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.628522] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.628522] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.628522] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.628522] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d9afc808-3692-46b5-a84b-018d8d2b7f94',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.630829] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-8515d9a8-a4ac-468f-8b0c-038d8d0a4e5c taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.630996] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8515d9a8-a4ac-468f-8b0c-038d8d0a4e5c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.630996] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8515d9a8-a4ac-468f-8b0c-038d8d0a4e5c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.631297] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8515d9a8-a4ac-468f-8b0c-038d8d0a4e5c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.631297] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8515d9a8-a4ac-468f-8b0c-038d8d0a4e5c',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.971883] env[65337]: INFO networking_nsxv3.common.synchronization [None req-64b063a0-3dc9-4366-a127-b442a06a533d None None] Enqueued Resource ID: 5accb536-ed99-4e3e-a1b8-913f802d6cc6 with Priority: HIGHEST for action port [ 708.972554] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5accb536-ed99-4e3e-a1b8-913f802d6cc6 with Priority: HIGHEST for action port [ 708.972893] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-5accb536-ed99-4e3e-a1b8-913f802d6cc6 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.973353] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5accb536-ed99-4e3e-a1b8-913f802d6cc6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.973502] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5accb536-ed99-4e3e-a1b8-913f802d6cc6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.974484] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5accb536-ed99-4e3e-a1b8-913f802d6cc6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.974484] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5accb536-ed99-4e3e-a1b8-913f802d6cc6',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.131037] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d9afc808-3692-46b5-a84b-018d8d2b7f94',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.136675] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9afc808-3692-46b5-a84b-018d8d2b7f94 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.136675] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9afc808-3692-46b5-a84b-018d8d2b7f94" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.136675] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8515d9a8-a4ac-468f-8b0c-038d8d0a4e5c with status ACTIVE [ 709.136899] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.136899] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.137667] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.137667] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.137667] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.137667] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.137838] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.137877] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.138252] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.138252] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.138421] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.138517] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.138599] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.138797] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.138937] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.141269] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8515d9a8-a4ac-468f-8b0c-038d8d0a4e5c is going to be updated. [ 709.162880] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.163112] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.163112] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.163322] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.163454] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.163619] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8515d9a8-a4ac-468f-8b0c-038d8d0a4e5c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.476940] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5accb536-ed99-4e3e-a1b8-913f802d6cc6 [ 709.476940] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.476940] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.477636] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.477636] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.477636] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.478124] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5accb536-ed99-4e3e-a1b8-913f802d6cc6 already deleted. [ 709.478255] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5accb536-ed99-4e3e-a1b8-913f802d6cc6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.636999] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d9afc808-3692-46b5-a84b-018d8d2b7f94',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.910668] env[65337]: INFO networking_nsxv3.common.synchronization [None req-c98f7af8-2bcd-42c3-9dff-67baa65ecfda None None] Enqueued Resource ID: 7bf03dd7-2cb3-441e-8fd0-c9c81d193f54 with Priority: HIGHEST for action port [ 709.911343] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7bf03dd7-2cb3-441e-8fd0-c9c81d193f54 with Priority: HIGHEST for action port [ 709.911977] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-7bf03dd7-2cb3-441e-8fd0-c9c81d193f54 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.911977] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7bf03dd7-2cb3-441e-8fd0-c9c81d193f54" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.911977] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7bf03dd7-2cb3-441e-8fd0-c9c81d193f54" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.915880] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7bf03dd7-2cb3-441e-8fd0-c9c81d193f54" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.915979] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7bf03dd7-2cb3-441e-8fd0-c9c81d193f54',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.139508] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.139656] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.139724] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.139939] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.140043] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.140167] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d9afc808-3692-46b5-a84b-018d8d2b7f94 is going to be created. [ 710.165526] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.165700] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.165756] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.165940] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.166112] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.176937] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d9afc808-3692-46b5-a84b-018d8d2b7f94 in Status: UNINITIALIZED for 2s [ 710.317244] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ee03c436-a01f-49f3-9012-42ca1b72c1d4 in Status: SUCCESS [ 710.317560] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ee03c436-a01f-49f3-9012-42ca1b72c1d4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.421438] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7bf03dd7-2cb3-441e-8fd0-c9c81d193f54 [ 710.421665] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.421800] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.421867] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.422140] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.422258] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.422331] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7bf03dd7-2cb3-441e-8fd0-c9c81d193f54 already deleted. [ 710.422408] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7bf03dd7-2cb3-441e-8fd0-c9c81d193f54" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.233051] env[65337]: INFO networking_nsxv3.common.synchronization [req-0f6ac1de-4eec-406f-bd03-4b4123a3292c req-a7aef0ef-31b3-4fbe-8459-ff4f8595a8e0 tempest-ServerRescueTestJSON-1216775078 tempest-ServerRescueTestJSON-1216775078-project-member] Enqueued Resource ID: 85232c6c-cd42-4a15-9924-943a4e75a091 with Priority: HIGHEST for action security_group_members [ 711.234303] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85232c6c-cd42-4a15-9924-943a4e75a091 with Priority: HIGHEST for action security_group_members [ 711.236391] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-85232c6c-cd42-4a15-9924-943a4e75a091 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.236391] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85232c6c-cd42-4a15-9924-943a4e75a091" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.236391] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85232c6c-cd42-4a15-9924-943a4e75a091" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.236783] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85232c6c-cd42-4a15-9924-943a4e75a091" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.236965] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.237172] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.237288] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.238298] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.238298] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.238298] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('85232c6c-cd42-4a15-9924-943a4e75a091',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.742382] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.742524] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.742592] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.743061] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.743061] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.743203] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.743266] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.743296] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.744503] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.744503] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.744503] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85232c6c-cd42-4a15-9924-943a4e75a091 already deleted. [ 711.744503] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85232c6c-cd42-4a15-9924-943a4e75a091" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.763335] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock network-775 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.765901] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "network-775" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.765901] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "network-775" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.766376] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "network-775" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.766794] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.769141] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.769141] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.769141] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.769141] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.769703] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 711.769900] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 711.770045] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 711.770167] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 711.770319] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 711.770421] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 711.770566] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 711.794670] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 711.794913] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 711.795102] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 711.795392] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "network-775" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.795894] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock port-38e59cf4-eea1-4751-bb41-3150d4eff598 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.796022] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "port-38e59cf4-eea1-4751-bb41-3150d4eff598" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.796072] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "port-38e59cf4-eea1-4751-bb41-3150d4eff598" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.796385] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "port-38e59cf4-eea1-4751-bb41-3150d4eff598" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.796523] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('38e59cf4-eea1-4751-bb41-3150d4eff598',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.188708] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d9afc808-3692-46b5-a84b-018d8d2b7f94 in Status: UNINITIALIZED for 4s [ 712.224907] env[65337]: INFO networking_nsxv3.common.synchronization [req-4de918b5-dc24-46fe-9a00-da30b2f7de32 req-9eb38d60-3aa3-4598-9510-9db5f6b9e3f5 tempest-ServersWithSpecificFlavorTestJSON-1708740375 tempest-ServersWithSpecificFlavorTestJSON-1708740375-project-member] Enqueued Resource ID: c26a679a-9c5d-4a72-b91b-bd7f21348ea0 with Priority: HIGHEST for action security_group_members [ 712.225648] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c26a679a-9c5d-4a72-b91b-bd7f21348ea0 with Priority: HIGHEST for action security_group_members [ 712.225967] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-c26a679a-9c5d-4a72-b91b-bd7f21348ea0 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.226126] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c26a679a-9c5d-4a72-b91b-bd7f21348ea0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.226200] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c26a679a-9c5d-4a72-b91b-bd7f21348ea0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.226426] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c26a679a-9c5d-4a72-b91b-bd7f21348ea0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.226599] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.226713] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.226780] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.226983] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.227061] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.227189] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c26a679a-9c5d-4a72-b91b-bd7f21348ea0',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.307182] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.307569] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.307569] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.307789] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.307930] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.308094] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Segment Port 38e59cf4-eea1-4751-bb41-3150d4eff598 not found, creating... [ 712.308434] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.308623] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.308737] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.308953] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.309101] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.309381] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.309529] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.309642] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.309831] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.309957] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.310104] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Resource: SegmentPort with ID: 38e59cf4-eea1-4751-bb41-3150d4eff598 is going to be created. [ 712.333693] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.334142] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.334183] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.334546] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.335112] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.335435] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "port-38e59cf4-eea1-4751-bb41-3150d4eff598" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.730362] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.730362] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.730362] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.730362] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.730362] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.730362] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.730823] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.730823] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.730823] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.730823] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.730994] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c26a679a-9c5d-4a72-b91b-bd7f21348ea0 is going to be updated. [ 712.769772] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.770580] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.770580] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.770580] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.770580] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.784124] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c26a679a-9c5d-4a72-b91b-bd7f21348ea0 in Status: IN_PROGRESS for 2s [ 712.859275] env[65337]: INFO networking_nsxv3.common.synchronization [req-dc4898d2-19d7-4cac-906c-8fd713f553a8 req-f5a1332b-0da0-4414-91b3-fcee4b966466 tempest-DeleteServersTestJSON-1654690426 tempest-DeleteServersTestJSON-1654690426-project-member] Enqueued Resource ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d with Priority: HIGHEST for action security_group_members [ 712.860041] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d with Priority: HIGHEST for action security_group_members [ 712.860492] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-161889a4-32a2-48ee-8fb7-d2a961a4b28d taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.860641] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.860702] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.862028] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.862028] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.862028] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.862028] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.862028] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.862028] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.862028] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('161889a4-32a2-48ee-8fb7-d2a961a4b28d',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.165358] env[65337]: INFO networking_nsxv3.common.synchronization [req-0f6ac1de-4eec-406f-bd03-4b4123a3292c req-7eecc717-6fc2-4f76-b0e6-eaecdd75de2a service nova] Enqueued Resource ID: 85232c6c-cd42-4a15-9924-943a4e75a091 with Priority: HIGHEST for action security_group_rules [ 713.165487] env[65337]: INFO networking_nsxv3.common.synchronization [req-0f6ac1de-4eec-406f-bd03-4b4123a3292c req-7eecc717-6fc2-4f76-b0e6-eaecdd75de2a service nova] Enqueued Resource ID: 85232c6c-cd42-4a15-9924-943a4e75a091 with Priority: HIGHEST for action security_group_members [ 713.165974] env[65337]: INFO networking_nsxv3.common.synchronization [req-0f6ac1de-4eec-406f-bd03-4b4123a3292c req-7eecc717-6fc2-4f76-b0e6-eaecdd75de2a service nova] Enqueued Resource ID: 38e59cf4-eea1-4751-bb41-3150d4eff598 with Priority: HIGHEST for action port [ 713.168945] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85232c6c-cd42-4a15-9924-943a4e75a091 with Priority: HIGHEST for action security_group_rules [ 713.168945] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85232c6c-cd42-4a15-9924-943a4e75a091 with Priority: HIGHEST for action security_group_members [ 713.168945] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38e59cf4-eea1-4751-bb41-3150d4eff598 with Priority: HIGHEST for action port [ 713.168945] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-85232c6c-cd42-4a15-9924-943a4e75a091 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.168945] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-85232c6c-cd42-4a15-9924-943a4e75a091" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.168945] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-85232c6c-cd42-4a15-9924-943a4e75a091" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.168945] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-85232c6c-cd42-4a15-9924-943a4e75a091" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.168945] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('85232c6c-cd42-4a15-9924-943a4e75a091',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.168945] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-85232c6c-cd42-4a15-9924-943a4e75a091 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.168945] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85232c6c-cd42-4a15-9924-943a4e75a091" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.168945] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85232c6c-cd42-4a15-9924-943a4e75a091" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.168945] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85232c6c-cd42-4a15-9924-943a4e75a091" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.169563] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.169563] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.169563] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.169563] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.169563] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.169563] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('85232c6c-cd42-4a15-9924-943a4e75a091',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.170661] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-38e59cf4-eea1-4751-bb41-3150d4eff598 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.170661] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-38e59cf4-eea1-4751-bb41-3150d4eff598" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.170661] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-38e59cf4-eea1-4751-bb41-3150d4eff598" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.170859] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-38e59cf4-eea1-4751-bb41-3150d4eff598" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.170859] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('38e59cf4-eea1-4751-bb41-3150d4eff598',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.365248] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.365248] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.365248] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.365248] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.365248] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.365248] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.365248] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.365248] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.365248] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.366527] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.366527] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d is going to be updated. [ 713.398719] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.399329] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.399329] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.400009] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.400009] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.410419] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d in Status: IN_PROGRESS for 2s [ 713.673584] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-85232c6c-cd42-4a15-9924-943a4e75a091 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.673750] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85232c6c-cd42-4a15-9924-943a4e75a091" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.673997] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('85232c6c-cd42-4a15-9924-943a4e75a091',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.675192] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 38e59cf4-eea1-4751-bb41-3150d4eff598 with status ACTIVE [ 713.675445] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.675594] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.675676] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.675927] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.676058] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.676404] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.676634] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.676900] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.680657] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.684309] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.684502] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.684657] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.684718] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.684908] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.684990] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.685136] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 38e59cf4-eea1-4751-bb41-3150d4eff598 is going to be updated. [ 713.718542] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.718724] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.718796] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.719623] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.719806] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.719970] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-38e59cf4-eea1-4751-bb41-3150d4eff598" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.052599] env[65337]: INFO networking_nsxv3.common.synchronization [req-05d320aa-0c39-43c0-848c-6117a837242b req-1ca063b0-68f1-4f4a-bde3-967e0b5a09a1 tempest-MigrationsAdminTest-367558634 tempest-MigrationsAdminTest-367558634-project-member] Enqueued Resource ID: d8e2d833-6da9-488a-a2b1-f410f4205706 with Priority: HIGHEST for action security_group_members [ 714.053312] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8e2d833-6da9-488a-a2b1-f410f4205706 with Priority: HIGHEST for action security_group_members [ 714.053524] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8e2d833-6da9-488a-a2b1-f410f4205706 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.053662] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8e2d833-6da9-488a-a2b1-f410f4205706" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.053716] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8e2d833-6da9-488a-a2b1-f410f4205706" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.054395] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8e2d833-6da9-488a-a2b1-f410f4205706" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.055330] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.055330] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.055330] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.055945] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.055945] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.055945] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d8e2d833-6da9-488a-a2b1-f410f4205706',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.189835] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('85232c6c-cd42-4a15-9924-943a4e75a091',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.202541] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d9afc808-3692-46b5-a84b-018d8d2b7f94 in Status: SUCCESS [ 714.202541] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9afc808-3692-46b5-a84b-018d8d2b7f94" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.207113] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9afc808-3692-46b5-a84b-018d8d2b7f94" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.207113] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9afc808-3692-46b5-a84b-018d8d2b7f94" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.207113] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.207113] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.207113] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.207113] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.207113] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.207113] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9afc808-3692-46b5-a84b-018d8d2b7f94" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.207113] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d9afc808-3692-46b5-a84b-018d8d2b7f94',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.558579] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d8e2d833-6da9-488a-a2b1-f410f4205706',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.571562] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock network-292 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.572421] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "network-292" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.572553] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "network-292" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.572815] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "network-292" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.573118] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.573281] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.573402] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.573625] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.573775] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.574144] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 714.574305] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 714.574593] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 714.574753] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 714.574896] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 714.575088] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 714.575307] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 714.604841] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 714.605158] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 714.605379] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 714.605659] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "network-292" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.606181] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock port-53451aeb-e086-447e-8ee8-143fe4430cd6 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.606454] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "port-53451aeb-e086-447e-8ee8-143fe4430cd6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.606647] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "port-53451aeb-e086-447e-8ee8-143fe4430cd6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.607478] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "port-53451aeb-e086-447e-8ee8-143fe4430cd6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.607478] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('53451aeb-e086-447e-8ee8-143fe4430cd6',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.610911] env[65337]: INFO networking_nsxv3.common.synchronization [None req-65eb876b-806f-4aff-91ea-6ac7aa866125 None None] Enqueued Resource ID: 6ed841b9-4e01-4ff4-abc7-dd70d6aac41c with Priority: HIGHEST for action port [ 714.612875] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ed841b9-4e01-4ff4-abc7-dd70d6aac41c with Priority: HIGHEST for action port [ 714.613501] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-6ed841b9-4e01-4ff4-abc7-dd70d6aac41c taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.613685] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6ed841b9-4e01-4ff4-abc7-dd70d6aac41c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.613801] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6ed841b9-4e01-4ff4-abc7-dd70d6aac41c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.614185] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6ed841b9-4e01-4ff4-abc7-dd70d6aac41c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.614317] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6ed841b9-4e01-4ff4-abc7-dd70d6aac41c',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.690691] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.690803] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.690915] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.691239] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.691340] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.691442] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85232c6c-cd42-4a15-9924-943a4e75a091 is going to be created. [ 714.708113] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9afc808-3692-46b5-a84b-018d8d2b7f94 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.708717] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9afc808-3692-46b5-a84b-018d8d2b7f94" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.708717] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9afc808-3692-46b5-a84b-018d8d2b7f94" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.708717] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9afc808-3692-46b5-a84b-018d8d2b7f94" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.708870] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.709221] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.709221] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.709387] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.709387] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.709441] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9afc808-3692-46b5-a84b-018d8d2b7f94" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.709580] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9afc808-3692-46b5-a84b-018d8d2b7f94 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.710037] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9afc808-3692-46b5-a84b-018d8d2b7f94" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.710037] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9afc808-3692-46b5-a84b-018d8d2b7f94" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.710037] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9afc808-3692-46b5-a84b-018d8d2b7f94" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.712246] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.712702] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.712702] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.712702] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.712702] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.712820] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9afc808-3692-46b5-a84b-018d8d2b7f94" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.712820] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d9afc808-3692-46b5-a84b-018d8d2b7f94',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.726824] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.727079] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.727079] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.727363] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.727561] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.743090] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85232c6c-cd42-4a15-9924-943a4e75a091 in Status: UNINITIALIZED for 2s [ 714.797832] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c26a679a-9c5d-4a72-b91b-bd7f21348ea0 in Status: SUCCESS [ 714.798440] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c26a679a-9c5d-4a72-b91b-bd7f21348ea0 deletion is rescheduled due to dependency. [ 714.798440] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c26a679a-9c5d-4a72-b91b-bd7f21348ea0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.063818] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d8e2d833-6da9-488a-a2b1-f410f4205706',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.113459] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.113677] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.113677] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.113909] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.114109] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.114271] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Segment Port 53451aeb-e086-447e-8ee8-143fe4430cd6 not found, creating... [ 715.114952] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.114952] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.114952] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.115282] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.115331] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.115650] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.115804] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.115932] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.116430] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.116430] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.116430] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Resource: SegmentPort with ID: 53451aeb-e086-447e-8ee8-143fe4430cd6 is going to be created. [ 715.117932] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6ed841b9-4e01-4ff4-abc7-dd70d6aac41c [ 715.118160] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.118247] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.118299] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.118508] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.118598] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.118687] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6ed841b9-4e01-4ff4-abc7-dd70d6aac41c already deleted. [ 715.118776] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6ed841b9-4e01-4ff4-abc7-dd70d6aac41c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.162170] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.162394] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.162517] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.162901] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.163169] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.163713] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "port-53451aeb-e086-447e-8ee8-143fe4430cd6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.216260] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d9afc808-3692-46b5-a84b-018d8d2b7f94: rpc.has_security_group_logging(os_id): False [ 715.238187] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.238355] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.238425] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.238989] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.238989] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.238989] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.238989] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.239172] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.239207] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.239282] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.239462] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.239563] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.239612] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.239747] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.239821] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.240014] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.240373] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.240438] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.240579] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.240656] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.240752] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d9afc808-3692-46b5-a84b-018d8d2b7f94 is going to be created. [ 715.365961] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.365961] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.365961] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.366408] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.366467] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.379656] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d9afc808-3692-46b5-a84b-018d8d2b7f94 in Status: IN_PROGRESS for 2s [ 715.427200] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d in Status: SUCCESS [ 715.427372] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d deletion is rescheduled due to dependency. [ 715.427494] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.567403] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.570025] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.570025] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.570025] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.570025] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.570025] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8e2d833-6da9-488a-a2b1-f410f4205706 is going to be updated. [ 715.614680] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.614872] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.614916] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.615143] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.615333] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.626409] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8e2d833-6da9-488a-a2b1-f410f4205706 in Status: IN_PROGRESS for 2s [ 715.968880] env[65337]: INFO networking_nsxv3.common.synchronization [req-05d320aa-0c39-43c0-848c-6117a837242b req-60620e1d-8ea6-4cde-8b97-518370597fe1 service nova] Enqueued Resource ID: d8e2d833-6da9-488a-a2b1-f410f4205706 with Priority: HIGHEST for action security_group_rules [ 715.969080] env[65337]: INFO networking_nsxv3.common.synchronization [req-05d320aa-0c39-43c0-848c-6117a837242b req-60620e1d-8ea6-4cde-8b97-518370597fe1 service nova] Enqueued Resource ID: d8e2d833-6da9-488a-a2b1-f410f4205706 with Priority: HIGHEST for action security_group_members [ 715.969213] env[65337]: INFO networking_nsxv3.common.synchronization [req-05d320aa-0c39-43c0-848c-6117a837242b req-60620e1d-8ea6-4cde-8b97-518370597fe1 service nova] Enqueued Resource ID: 53451aeb-e086-447e-8ee8-143fe4430cd6 with Priority: HIGHEST for action port [ 715.969446] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8e2d833-6da9-488a-a2b1-f410f4205706 with Priority: HIGHEST for action security_group_rules [ 715.969571] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8e2d833-6da9-488a-a2b1-f410f4205706 with Priority: HIGHEST for action security_group_members [ 715.969664] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53451aeb-e086-447e-8ee8-143fe4430cd6 with Priority: HIGHEST for action port [ 715.974646] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d8e2d833-6da9-488a-a2b1-f410f4205706 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.974719] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d8e2d833-6da9-488a-a2b1-f410f4205706" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.974833] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d8e2d833-6da9-488a-a2b1-f410f4205706" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.975155] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d8e2d833-6da9-488a-a2b1-f410f4205706" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.975251] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d8e2d833-6da9-488a-a2b1-f410f4205706',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.976244] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8e2d833-6da9-488a-a2b1-f410f4205706 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.976343] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8e2d833-6da9-488a-a2b1-f410f4205706" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.976531] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-53451aeb-e086-447e-8ee8-143fe4430cd6 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.977699] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-53451aeb-e086-447e-8ee8-143fe4430cd6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.977778] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-53451aeb-e086-447e-8ee8-143fe4430cd6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.977996] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-53451aeb-e086-447e-8ee8-143fe4430cd6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.978091] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('53451aeb-e086-447e-8ee8-143fe4430cd6',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.482193] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8e2d833-6da9-488a-a2b1-f410f4205706 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.482193] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8e2d833-6da9-488a-a2b1-f410f4205706" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.482443] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 53451aeb-e086-447e-8ee8-143fe4430cd6 with status ACTIVE [ 716.482493] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.482643] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.482731] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.482962] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.483077] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.486024] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.486024] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.486024] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.486024] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.486024] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.486024] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.486024] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.486024] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.486024] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.486024] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.486024] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 53451aeb-e086-447e-8ee8-143fe4430cd6 is going to be updated. [ 716.539107] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.539392] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.539529] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.539965] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.540179] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.540494] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-53451aeb-e086-447e-8ee8-143fe4430cd6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.754708] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85232c6c-cd42-4a15-9924-943a4e75a091 in Status: SUCCESS [ 716.755156] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85232c6c-cd42-4a15-9924-943a4e75a091" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.755215] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85232c6c-cd42-4a15-9924-943a4e75a091" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.755426] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85232c6c-cd42-4a15-9924-943a4e75a091" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.755667] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.755792] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.755866] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.756038] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.756144] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.756248] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85232c6c-cd42-4a15-9924-943a4e75a091" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.756365] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('85232c6c-cd42-4a15-9924-943a4e75a091',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.789015] env[65337]: INFO networking_nsxv3.common.synchronization [req-b9d05f27-1e81-4d81-81cd-248121c8359f req-de04d7b6-0e82-48e0-8c3f-77ba43855326 tempest-SecurityGroupsTestJSON-920822125 tempest-SecurityGroupsTestJSON-920822125-project-member] Enqueued Resource ID: 755f030a-6e7c-43ec-adb9-cb4c270ad532 with Priority: HIGHEST for action security_group_members [ 716.789015] env[65337]: INFO networking_nsxv3.common.synchronization [req-b9d05f27-1e81-4d81-81cd-248121c8359f req-de04d7b6-0e82-48e0-8c3f-77ba43855326 tempest-SecurityGroupsTestJSON-920822125 tempest-SecurityGroupsTestJSON-920822125-project-member] Enqueued Resource ID: ebb204e1-ff28-4709-a165-ad95f8c27d8b with Priority: HIGHEST for action security_group_members [ 716.789015] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 755f030a-6e7c-43ec-adb9-cb4c270ad532 with Priority: HIGHEST for action security_group_members [ 716.789015] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebb204e1-ff28-4709-a165-ad95f8c27d8b with Priority: HIGHEST for action security_group_members [ 716.789015] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-755f030a-6e7c-43ec-adb9-cb4c270ad532 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.789015] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.789015] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.789015] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.789015] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.789015] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.789015] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.789015] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.789015] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.789015] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('755f030a-6e7c-43ec-adb9-cb4c270ad532',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.792312] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebb204e1-ff28-4709-a165-ad95f8c27d8b taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.792312] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebb204e1-ff28-4709-a165-ad95f8c27d8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.792312] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebb204e1-ff28-4709-a165-ad95f8c27d8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.792312] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebb204e1-ff28-4709-a165-ad95f8c27d8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.792312] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.792312] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.792312] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.792312] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.792312] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.792312] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ebb204e1-ff28-4709-a165-ad95f8c27d8b',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.859393] env[65337]: INFO networking_nsxv3.common.synchronization [req-b9d05f27-1e81-4d81-81cd-248121c8359f req-de04d7b6-0e82-48e0-8c3f-77ba43855326 tempest-SecurityGroupsTestJSON-920822125 tempest-SecurityGroupsTestJSON-920822125-project-member] Enqueued Resource ID: 755f030a-6e7c-43ec-adb9-cb4c270ad532 with Priority: HIGHEST for action security_group_rules [ 716.859596] env[65337]: INFO networking_nsxv3.common.synchronization [req-b9d05f27-1e81-4d81-81cd-248121c8359f req-de04d7b6-0e82-48e0-8c3f-77ba43855326 tempest-SecurityGroupsTestJSON-920822125 tempest-SecurityGroupsTestJSON-920822125-project-member] Enqueued Resource ID: 755f030a-6e7c-43ec-adb9-cb4c270ad532 with Priority: HIGHEST for action security_group_members [ 716.859726] env[65337]: INFO networking_nsxv3.common.synchronization [req-b9d05f27-1e81-4d81-81cd-248121c8359f req-de04d7b6-0e82-48e0-8c3f-77ba43855326 tempest-SecurityGroupsTestJSON-920822125 tempest-SecurityGroupsTestJSON-920822125-project-member] Enqueued Resource ID: ebb204e1-ff28-4709-a165-ad95f8c27d8b with Priority: HIGHEST for action security_group_rules [ 716.859844] env[65337]: INFO networking_nsxv3.common.synchronization [req-b9d05f27-1e81-4d81-81cd-248121c8359f req-de04d7b6-0e82-48e0-8c3f-77ba43855326 tempest-SecurityGroupsTestJSON-920822125 tempest-SecurityGroupsTestJSON-920822125-project-member] Enqueued Resource ID: ebb204e1-ff28-4709-a165-ad95f8c27d8b with Priority: HIGHEST for action security_group_members [ 716.859961] env[65337]: INFO networking_nsxv3.common.synchronization [req-b9d05f27-1e81-4d81-81cd-248121c8359f req-de04d7b6-0e82-48e0-8c3f-77ba43855326 tempest-SecurityGroupsTestJSON-920822125 tempest-SecurityGroupsTestJSON-920822125-project-member] Enqueued Resource ID: 71ec9dc6-358b-4444-9c85-6c8f2b7819e5 with Priority: HIGHEST for action port [ 716.860469] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 755f030a-6e7c-43ec-adb9-cb4c270ad532 with Priority: HIGHEST for action security_group_rules [ 716.860620] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebb204e1-ff28-4709-a165-ad95f8c27d8b with Priority: HIGHEST for action security_group_rules [ 716.860720] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71ec9dc6-358b-4444-9c85-6c8f2b7819e5 with Priority: HIGHEST for action port [ 716.860811] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 755f030a-6e7c-43ec-adb9-cb4c270ad532 with Priority: HIGHEST for action security_group_members [ 716.860896] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebb204e1-ff28-4709-a165-ad95f8c27d8b with Priority: HIGHEST for action security_group_members [ 716.861174] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-755f030a-6e7c-43ec-adb9-cb4c270ad532 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.861390] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.861390] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.861612] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.861685] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('755f030a-6e7c-43ec-adb9-cb4c270ad532',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.862769] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ebb204e1-ff28-4709-a165-ad95f8c27d8b taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.862911] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ebb204e1-ff28-4709-a165-ad95f8c27d8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.862983] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ebb204e1-ff28-4709-a165-ad95f8c27d8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.863365] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ebb204e1-ff28-4709-a165-ad95f8c27d8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.863365] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ebb204e1-ff28-4709-a165-ad95f8c27d8b',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.864022] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-71ec9dc6-358b-4444-9c85-6c8f2b7819e5 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.864124] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-71ec9dc6-358b-4444-9c85-6c8f2b7819e5" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.864180] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-71ec9dc6-358b-4444-9c85-6c8f2b7819e5" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.864339] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-71ec9dc6-358b-4444-9c85-6c8f2b7819e5" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.864416] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('71ec9dc6-358b-4444-9c85-6c8f2b7819e5',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.865136] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-755f030a-6e7c-43ec-adb9-cb4c270ad532 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.865237] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.865402] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebb204e1-ff28-4709-a165-ad95f8c27d8b taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.865512] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebb204e1-ff28-4709-a165-ad95f8c27d8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.259168] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-85232c6c-cd42-4a15-9924-943a4e75a091 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.259514] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85232c6c-cd42-4a15-9924-943a4e75a091" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.259514] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85232c6c-cd42-4a15-9924-943a4e75a091" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.259654] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85232c6c-cd42-4a15-9924-943a4e75a091" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.259822] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.259942] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.260012] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.260166] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.260256] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.260343] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85232c6c-cd42-4a15-9924-943a4e75a091" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.260482] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-85232c6c-cd42-4a15-9924-943a4e75a091 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.260574] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85232c6c-cd42-4a15-9924-943a4e75a091" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.260819] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85232c6c-cd42-4a15-9924-943a4e75a091" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.260819] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85232c6c-cd42-4a15-9924-943a4e75a091" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.260899] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.260994] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.261053] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.261180] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.261255] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.261336] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85232c6c-cd42-4a15-9924-943a4e75a091" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.261422] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('85232c6c-cd42-4a15-9924-943a4e75a091',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.294129] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('755f030a-6e7c-43ec-adb9-cb4c270ad532',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.295448] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ebb204e1-ff28-4709-a165-ad95f8c27d8b',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.368346] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-755f030a-6e7c-43ec-adb9-cb4c270ad532 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.368507] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.368739] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebb204e1-ff28-4709-a165-ad95f8c27d8b taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.368841] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebb204e1-ff28-4709-a165-ad95f8c27d8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.369544] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 71ec9dc6-358b-4444-9c85-6c8f2b7819e5 with status ACTIVE [ 717.369710] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.369828] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.369868] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.370096] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.370216] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.370513] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.370513] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.370619] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.370758] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.370847] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.371069] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.371167] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.371227] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.371367] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.371440] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.371780] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 71ec9dc6-358b-4444-9c85-6c8f2b7819e5 is going to be updated. [ 717.394313] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d9afc808-3692-46b5-a84b-018d8d2b7f94 in Status: SUCCESS [ 717.394643] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d9afc808-3692-46b5-a84b-018d8d2b7f94" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.402861] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.402861] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.402861] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.402861] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.402861] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.402861] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-71ec9dc6-358b-4444-9c85-6c8f2b7819e5" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.639233] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8e2d833-6da9-488a-a2b1-f410f4205706 in Status: SUCCESS [ 717.639543] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8e2d833-6da9-488a-a2b1-f410f4205706" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.639716] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8e2d833-6da9-488a-a2b1-f410f4205706" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.639939] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8e2d833-6da9-488a-a2b1-f410f4205706" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.640142] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.640258] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.640341] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.640507] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.640597] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.640693] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d8e2d833-6da9-488a-a2b1-f410f4205706',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.764835] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 85232c6c-cd42-4a15-9924-943a4e75a091: rpc.has_security_group_logging(os_id): False [ 717.786624] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.786624] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.786624] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.786878] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.786986] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.787156] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.787305] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.787305] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.787444] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.787516] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.787691] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.787786] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.787908] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.787963] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.788192] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.788287] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.788287] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.788404] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.790325] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.790325] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.790325] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 85232c6c-cd42-4a15-9924-943a4e75a091 is going to be created. [ 717.796376] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ebb204e1-ff28-4709-a165-ad95f8c27d8b',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.799766] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('755f030a-6e7c-43ec-adb9-cb4c270ad532',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.855534] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.855668] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.855715] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.855932] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.856130] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.867933] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 85232c6c-cd42-4a15-9924-943a4e75a091 in Status: IN_PROGRESS for 2s [ 718.143496] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d8e2d833-6da9-488a-a2b1-f410f4205706',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.300199] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.300375] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.300424] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.300651] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.300737] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.300845] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ebb204e1-ff28-4709-a165-ad95f8c27d8b is going to be created. [ 718.302541] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.302696] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.302769] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.305679] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.307319] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.307319] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 755f030a-6e7c-43ec-adb9-cb4c270ad532 is going to be updated. [ 718.340811] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.340982] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.341071] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.341375] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.341643] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.348888] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.349072] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.349114] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.349430] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.349690] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.356922] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebb204e1-ff28-4709-a165-ad95f8c27d8b in Status: UNINITIALIZED for 2s [ 718.363148] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 755f030a-6e7c-43ec-adb9-cb4c270ad532 in Status: IN_PROGRESS for 2s [ 718.645774] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d8e2d833-6da9-488a-a2b1-f410f4205706',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.024061] env[65337]: INFO networking_nsxv3.common.synchronization [req-723186a6-afc4-4b4e-8699-bc3d43e8c9a5 req-a9124b3c-7224-4aaa-9b34-5d0b55e6de99 tempest-SecurityGroupsTestJSON-920822125 tempest-SecurityGroupsTestJSON-920822125-project-member] Enqueued Resource ID: 5289c470-2cbe-4957-bd37-f39138ab0a31 with Priority: HIGHEST for action security_group_members [ 719.024328] env[65337]: INFO networking_nsxv3.common.synchronization [req-723186a6-afc4-4b4e-8699-bc3d43e8c9a5 req-a9124b3c-7224-4aaa-9b34-5d0b55e6de99 tempest-SecurityGroupsTestJSON-920822125 tempest-SecurityGroupsTestJSON-920822125-project-member] Enqueued Resource ID: 755f030a-6e7c-43ec-adb9-cb4c270ad532 with Priority: HIGHEST for action security_group_members [ 719.024328] env[65337]: INFO networking_nsxv3.common.synchronization [req-723186a6-afc4-4b4e-8699-bc3d43e8c9a5 req-a9124b3c-7224-4aaa-9b34-5d0b55e6de99 tempest-SecurityGroupsTestJSON-920822125 tempest-SecurityGroupsTestJSON-920822125-project-member] Enqueued Resource ID: ebb204e1-ff28-4709-a165-ad95f8c27d8b with Priority: HIGHEST for action security_group_members [ 719.024915] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5289c470-2cbe-4957-bd37-f39138ab0a31 with Priority: HIGHEST for action security_group_members [ 719.025127] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 755f030a-6e7c-43ec-adb9-cb4c270ad532 with Priority: HIGHEST for action security_group_members [ 719.025246] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebb204e1-ff28-4709-a165-ad95f8c27d8b with Priority: HIGHEST for action security_group_members [ 719.025538] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-5289c470-2cbe-4957-bd37-f39138ab0a31 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.025666] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5289c470-2cbe-4957-bd37-f39138ab0a31" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.025731] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5289c470-2cbe-4957-bd37-f39138ab0a31" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.026014] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5289c470-2cbe-4957-bd37-f39138ab0a31" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.026201] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.026298] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.026385] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.026548] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.026635] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.026732] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5289c470-2cbe-4957-bd37-f39138ab0a31',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.029940] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-755f030a-6e7c-43ec-adb9-cb4c270ad532 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.030097] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.030431] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebb204e1-ff28-4709-a165-ad95f8c27d8b taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.030431] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebb204e1-ff28-4709-a165-ad95f8c27d8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.106994] env[65337]: INFO networking_nsxv3.common.synchronization [req-723186a6-afc4-4b4e-8699-bc3d43e8c9a5 req-a9124b3c-7224-4aaa-9b34-5d0b55e6de99 tempest-SecurityGroupsTestJSON-920822125 tempest-SecurityGroupsTestJSON-920822125-project-member] Enqueued Resource ID: 5289c470-2cbe-4957-bd37-f39138ab0a31 with Priority: HIGHEST for action security_group_rules [ 719.107240] env[65337]: INFO networking_nsxv3.common.synchronization [req-723186a6-afc4-4b4e-8699-bc3d43e8c9a5 req-a9124b3c-7224-4aaa-9b34-5d0b55e6de99 tempest-SecurityGroupsTestJSON-920822125 tempest-SecurityGroupsTestJSON-920822125-project-member] Enqueued Resource ID: 5289c470-2cbe-4957-bd37-f39138ab0a31 with Priority: HIGHEST for action security_group_members [ 719.107386] env[65337]: INFO networking_nsxv3.common.synchronization [req-723186a6-afc4-4b4e-8699-bc3d43e8c9a5 req-a9124b3c-7224-4aaa-9b34-5d0b55e6de99 tempest-SecurityGroupsTestJSON-920822125 tempest-SecurityGroupsTestJSON-920822125-project-member] Enqueued Resource ID: 755f030a-6e7c-43ec-adb9-cb4c270ad532 with Priority: HIGHEST for action security_group_rules [ 719.107506] env[65337]: INFO networking_nsxv3.common.synchronization [req-723186a6-afc4-4b4e-8699-bc3d43e8c9a5 req-a9124b3c-7224-4aaa-9b34-5d0b55e6de99 tempest-SecurityGroupsTestJSON-920822125 tempest-SecurityGroupsTestJSON-920822125-project-member] Enqueued Resource ID: 755f030a-6e7c-43ec-adb9-cb4c270ad532 with Priority: HIGHEST for action security_group_members [ 719.107710] env[65337]: INFO networking_nsxv3.common.synchronization [req-723186a6-afc4-4b4e-8699-bc3d43e8c9a5 req-a9124b3c-7224-4aaa-9b34-5d0b55e6de99 tempest-SecurityGroupsTestJSON-920822125 tempest-SecurityGroupsTestJSON-920822125-project-member] Enqueued Resource ID: ebb204e1-ff28-4709-a165-ad95f8c27d8b with Priority: HIGHEST for action security_group_rules [ 719.107836] env[65337]: INFO networking_nsxv3.common.synchronization [req-723186a6-afc4-4b4e-8699-bc3d43e8c9a5 req-a9124b3c-7224-4aaa-9b34-5d0b55e6de99 tempest-SecurityGroupsTestJSON-920822125 tempest-SecurityGroupsTestJSON-920822125-project-member] Enqueued Resource ID: ebb204e1-ff28-4709-a165-ad95f8c27d8b with Priority: HIGHEST for action security_group_members [ 719.107949] env[65337]: INFO networking_nsxv3.common.synchronization [req-723186a6-afc4-4b4e-8699-bc3d43e8c9a5 req-a9124b3c-7224-4aaa-9b34-5d0b55e6de99 tempest-SecurityGroupsTestJSON-920822125 tempest-SecurityGroupsTestJSON-920822125-project-member] Enqueued Resource ID: 71ec9dc6-358b-4444-9c85-6c8f2b7819e5 with Priority: HIGHEST for action port [ 719.110013] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5289c470-2cbe-4957-bd37-f39138ab0a31 with Priority: HIGHEST for action security_group_rules [ 719.110243] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 755f030a-6e7c-43ec-adb9-cb4c270ad532 with Priority: HIGHEST for action security_group_rules [ 719.110416] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebb204e1-ff28-4709-a165-ad95f8c27d8b with Priority: HIGHEST for action security_group_members [ 719.110554] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71ec9dc6-358b-4444-9c85-6c8f2b7819e5 with Priority: HIGHEST for action port [ 719.110707] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebb204e1-ff28-4709-a165-ad95f8c27d8b with Priority: HIGHEST for action security_group_rules [ 719.111812] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5289c470-2cbe-4957-bd37-f39138ab0a31 with Priority: HIGHEST for action security_group_members [ 719.111812] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 755f030a-6e7c-43ec-adb9-cb4c270ad532 with Priority: HIGHEST for action security_group_members [ 719.112314] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5289c470-2cbe-4957-bd37-f39138ab0a31 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.112389] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5289c470-2cbe-4957-bd37-f39138ab0a31" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.112624] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5289c470-2cbe-4957-bd37-f39138ab0a31" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.112829] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5289c470-2cbe-4957-bd37-f39138ab0a31" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.113053] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5289c470-2cbe-4957-bd37-f39138ab0a31',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.114559] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-755f030a-6e7c-43ec-adb9-cb4c270ad532 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.115188] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.115188] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebb204e1-ff28-4709-a165-ad95f8c27d8b taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.115188] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebb204e1-ff28-4709-a165-ad95f8c27d8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.115448] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-71ec9dc6-358b-4444-9c85-6c8f2b7819e5 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.115611] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-71ec9dc6-358b-4444-9c85-6c8f2b7819e5" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.115708] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-71ec9dc6-358b-4444-9c85-6c8f2b7819e5" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.117036] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-71ec9dc6-358b-4444-9c85-6c8f2b7819e5" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.117036] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('71ec9dc6-358b-4444-9c85-6c8f2b7819e5',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.117036] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ebb204e1-ff28-4709-a165-ad95f8c27d8b taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.117698] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ebb204e1-ff28-4709-a165-ad95f8c27d8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.117698] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-5289c470-2cbe-4957-bd37-f39138ab0a31 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.117805] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5289c470-2cbe-4957-bd37-f39138ab0a31" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.118725] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-755f030a-6e7c-43ec-adb9-cb4c270ad532 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.118725] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.150053] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.150053] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.150053] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.150701] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.150740] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.150822] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8e2d833-6da9-488a-a2b1-f410f4205706 is going to be updated. [ 719.156403] env[65337]: INFO networking_nsxv3.common.synchronization [req-88ab4d08-3479-432f-bb6f-c24563f63967 req-11d7ac89-8853-4237-88d0-ade9b9ad17e5 tempest-ServersTestManualDisk-1284221232 tempest-ServersTestManualDisk-1284221232-project-member] Enqueued Resource ID: 4f8577ef-eb55-481e-9197-98761298b164 with Priority: HIGHEST for action security_group_members [ 719.158086] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f8577ef-eb55-481e-9197-98761298b164 with Priority: HIGHEST for action security_group_members [ 719.158347] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f8577ef-eb55-481e-9197-98761298b164 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.158637] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f8577ef-eb55-481e-9197-98761298b164" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.158805] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f8577ef-eb55-481e-9197-98761298b164" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.160296] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f8577ef-eb55-481e-9197-98761298b164" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.160296] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.160296] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.160296] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.160296] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.160296] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.160296] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4f8577ef-eb55-481e-9197-98761298b164',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.202962] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.202962] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.202962] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.202962] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.202962] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.217250] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8e2d833-6da9-488a-a2b1-f410f4205706 in Status: IN_PROGRESS for 2s [ 719.534855] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5289c470-2cbe-4957-bd37-f39138ab0a31',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.623023] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 71ec9dc6-358b-4444-9c85-6c8f2b7819e5 with status ACTIVE [ 719.623023] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.623023] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.623023] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.623023] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.623023] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.623023] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.623023] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.623023] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.623023] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.623023] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.623023] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.623023] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.623023] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.623023] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.623023] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.623023] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 71ec9dc6-358b-4444-9c85-6c8f2b7819e5 is going to be updated. [ 719.624302] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-5289c470-2cbe-4957-bd37-f39138ab0a31 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.624776] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5289c470-2cbe-4957-bd37-f39138ab0a31" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.652198] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.652198] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.652198] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.652198] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.652198] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.652198] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-71ec9dc6-358b-4444-9c85-6c8f2b7819e5" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.663334] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.663334] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.663334] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.663334] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.664328] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.666024] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.666024] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.666024] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.666024] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.666024] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.666024] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f8577ef-eb55-481e-9197-98761298b164 is going to be updated. [ 719.704244] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.704429] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.704474] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.704791] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.706411] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.722428] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f8577ef-eb55-481e-9197-98761298b164 in Status: IN_PROGRESS for 2s [ 719.886759] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 85232c6c-cd42-4a15-9924-943a4e75a091 in Status: SUCCESS [ 719.887500] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-85232c6c-cd42-4a15-9924-943a4e75a091" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.037513] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5289c470-2cbe-4957-bd37-f39138ab0a31',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.041830] env[65337]: INFO networking_nsxv3.common.synchronization [req-5f63be75-6c98-40cb-81d8-9a34e5194c9e req-14437e87-f445-4a70-b78b-6703635692b6 tempest-ImagesTestJSON-1531636912 tempest-ImagesTestJSON-1531636912-project-member] Enqueued Resource ID: 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 with Priority: HIGHEST for action security_group_members [ 720.042836] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 with Priority: HIGHEST for action security_group_members [ 720.042919] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.043044] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.043124] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.043316] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.043554] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.043629] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.043629] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.043801] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.043922] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.043984] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7db87dc2-69af-45f1-90c2-f8a4ec96c3b7',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.369221] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebb204e1-ff28-4709-a165-ad95f8c27d8b in Status: SUCCESS [ 720.369836] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebb204e1-ff28-4709-a165-ad95f8c27d8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.369836] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebb204e1-ff28-4709-a165-ad95f8c27d8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.370127] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebb204e1-ff28-4709-a165-ad95f8c27d8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.370127] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.370211] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.370466] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.370466] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.370466] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.371170] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ebb204e1-ff28-4709-a165-ad95f8c27d8b',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.375179] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 755f030a-6e7c-43ec-adb9-cb4c270ad532 in Status: SUCCESS [ 720.376864] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.376864] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.376864] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.376864] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.376864] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.376864] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.376864] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.376864] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.376864] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('755f030a-6e7c-43ec-adb9-cb4c270ad532',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.540837] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.542812] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.542812] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.542812] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.542812] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.542812] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5289c470-2cbe-4957-bd37-f39138ab0a31 is going to be created. [ 720.549244] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.549553] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.549553] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.549910] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.549910] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.550016] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.550100] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.550100] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.550233] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.550332] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.551014] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 is going to be updated. [ 720.573200] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.573338] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.573405] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.573621] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.573779] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.598518] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5289c470-2cbe-4957-bd37-f39138ab0a31 in Status: UNINITIALIZED for 2s [ 720.602944] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.602944] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.603170] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.603251] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.603415] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.616365] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 in Status: IN_PROGRESS for 2s [ 720.874153] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ebb204e1-ff28-4709-a165-ad95f8c27d8b',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.879296] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('755f030a-6e7c-43ec-adb9-cb4c270ad532',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.238252] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8e2d833-6da9-488a-a2b1-f410f4205706 in Status: IN_PROGRESS for 4s [ 721.378482] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ebb204e1-ff28-4709-a165-ad95f8c27d8b',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.382196] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('755f030a-6e7c-43ec-adb9-cb4c270ad532',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.659460] env[65337]: INFO networking_nsxv3.common.synchronization [req-fd2070d8-5115-487d-ab10-240164a5f5dd req-0260443f-f5f7-45a2-bc53-5126de1405a6 tempest-ServersNegativeTestMultiTenantJSON-1788018303 tempest-ServersNegativeTestMultiTenantJSON-1788018303-project-member] Enqueued Resource ID: 5f3badd2-7106-4670-baaf-51e2d735f908 with Priority: HIGHEST for action security_group_members [ 721.660268] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f3badd2-7106-4670-baaf-51e2d735f908 with Priority: HIGHEST for action security_group_members [ 721.661053] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f3badd2-7106-4670-baaf-51e2d735f908 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.661053] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f3badd2-7106-4670-baaf-51e2d735f908" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.661053] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f3badd2-7106-4670-baaf-51e2d735f908" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.661323] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f3badd2-7106-4670-baaf-51e2d735f908" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.661648] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.661814] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.661926] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.662600] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.662600] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.662600] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5f3badd2-7106-4670-baaf-51e2d735f908',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.742659] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f8577ef-eb55-481e-9197-98761298b164 in Status: SUCCESS [ 721.742906] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f8577ef-eb55-481e-9197-98761298b164 deletion is rescheduled due to dependency. [ 721.742998] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f8577ef-eb55-481e-9197-98761298b164" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.882205] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.882365] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.882962] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.882962] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.882962] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.883155] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ebb204e1-ff28-4709-a165-ad95f8c27d8b is going to be updated. [ 721.886571] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.886571] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.886571] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.886571] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.886571] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.886571] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 755f030a-6e7c-43ec-adb9-cb4c270ad532 is going to be updated. [ 721.926025] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.926025] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.926025] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.926025] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.926625] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.932031] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.932031] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.932031] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.932031] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.932031] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.945526] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebb204e1-ff28-4709-a165-ad95f8c27d8b in Status: IN_PROGRESS for 2s [ 721.946882] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 755f030a-6e7c-43ec-adb9-cb4c270ad532 in Status: IN_PROGRESS for 2s [ 722.168626] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.168802] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.168841] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.169063] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.169153] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.170772] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.170915] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.170960] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.171610] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.171610] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.171610] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5f3badd2-7106-4670-baaf-51e2d735f908 already deleted. [ 722.173618] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f3badd2-7106-4670-baaf-51e2d735f908" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.404923] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock network-940 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.404923] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "network-940" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.405472] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "network-940" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.405731] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "network-940" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.405853] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.406896] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.406896] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.406896] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.407072] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.407973] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 722.407973] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 722.407973] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 722.407973] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 722.408278] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 722.409380] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 722.409380] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 722.437320] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 722.437501] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 722.437876] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 722.438252] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "network-940" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.438783] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock port-3167b3de-faa4-442d-89d7-24525691b3bb taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.439433] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "port-3167b3de-faa4-442d-89d7-24525691b3bb" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.440037] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "port-3167b3de-faa4-442d-89d7-24525691b3bb" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.440685] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "port-3167b3de-faa4-442d-89d7-24525691b3bb" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.440991] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3167b3de-faa4-442d-89d7-24525691b3bb',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.609762] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5289c470-2cbe-4957-bd37-f39138ab0a31 in Status: SUCCESS [ 722.610015] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5289c470-2cbe-4957-bd37-f39138ab0a31" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.610366] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5289c470-2cbe-4957-bd37-f39138ab0a31" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.610608] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5289c470-2cbe-4957-bd37-f39138ab0a31" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.610957] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.610957] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.610957] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.612593] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.612593] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.612593] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5289c470-2cbe-4957-bd37-f39138ab0a31',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.625809] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 in Status: SUCCESS [ 722.626041] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 deletion is rescheduled due to dependency. [ 722.626164] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.945137] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.945532] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.945739] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.946189] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.946437] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.946681] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Segment Port 3167b3de-faa4-442d-89d7-24525691b3bb not found, creating... [ 722.947164] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.947407] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.947592] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.948032] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.948175] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.948616] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.948844] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.949029] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.949333] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.949522] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.949721] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Resource: SegmentPort with ID: 3167b3de-faa4-442d-89d7-24525691b3bb is going to be created. [ 722.974113] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.974424] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.974604] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.974981] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.975311] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.975631] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "port-3167b3de-faa4-442d-89d7-24525691b3bb" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.113859] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5289c470-2cbe-4957-bd37-f39138ab0a31',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.247423] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8e2d833-6da9-488a-a2b1-f410f4205706 in Status: SUCCESS [ 723.247598] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8e2d833-6da9-488a-a2b1-f410f4205706" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.247858] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8e2d833-6da9-488a-a2b1-f410f4205706" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.248113] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8e2d833-6da9-488a-a2b1-f410f4205706" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.248362] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.248496] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.248563] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.248720] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.248809] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.248895] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8e2d833-6da9-488a-a2b1-f410f4205706" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.248989] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d8e2d833-6da9-488a-a2b1-f410f4205706',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.616474] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5289c470-2cbe-4957-bd37-f39138ab0a31',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.736901] env[65337]: INFO networking_nsxv3.common.synchronization [req-fd2070d8-5115-487d-ab10-240164a5f5dd req-046d085d-1c7d-4e12-83c1-0ccf6f51b85f service nova] Enqueued Resource ID: 5f3badd2-7106-4670-baaf-51e2d735f908 with Priority: HIGHEST for action security_group_rules [ 723.737233] env[65337]: INFO networking_nsxv3.common.synchronization [req-fd2070d8-5115-487d-ab10-240164a5f5dd req-046d085d-1c7d-4e12-83c1-0ccf6f51b85f service nova] Enqueued Resource ID: 5f3badd2-7106-4670-baaf-51e2d735f908 with Priority: HIGHEST for action security_group_members [ 723.737491] env[65337]: INFO networking_nsxv3.common.synchronization [req-fd2070d8-5115-487d-ab10-240164a5f5dd req-046d085d-1c7d-4e12-83c1-0ccf6f51b85f service nova] Enqueued Resource ID: 3167b3de-faa4-442d-89d7-24525691b3bb with Priority: HIGHEST for action port [ 723.738184] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f3badd2-7106-4670-baaf-51e2d735f908 with Priority: HIGHEST for action security_group_rules [ 723.738357] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f3badd2-7106-4670-baaf-51e2d735f908 with Priority: HIGHEST for action security_group_members [ 723.738481] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3167b3de-faa4-442d-89d7-24525691b3bb with Priority: HIGHEST for action port [ 723.738813] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5f3badd2-7106-4670-baaf-51e2d735f908 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.738983] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5f3badd2-7106-4670-baaf-51e2d735f908" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.739042] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5f3badd2-7106-4670-baaf-51e2d735f908" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.739409] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5f3badd2-7106-4670-baaf-51e2d735f908" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.739544] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5f3badd2-7106-4670-baaf-51e2d735f908',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.740866] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f3badd2-7106-4670-baaf-51e2d735f908 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.740866] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f3badd2-7106-4670-baaf-51e2d735f908" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.740866] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f3badd2-7106-4670-baaf-51e2d735f908" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.741215] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f3badd2-7106-4670-baaf-51e2d735f908" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.741346] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.741593] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.741659] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.742222] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.742222] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.742222] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5f3badd2-7106-4670-baaf-51e2d735f908',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.743146] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-3167b3de-faa4-442d-89d7-24525691b3bb taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.743283] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3167b3de-faa4-442d-89d7-24525691b3bb" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.744497] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3167b3de-faa4-442d-89d7-24525691b3bb" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.744730] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3167b3de-faa4-442d-89d7-24525691b3bb" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.744904] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3167b3de-faa4-442d-89d7-24525691b3bb',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.751987] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8e2d833-6da9-488a-a2b1-f410f4205706 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.752129] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8e2d833-6da9-488a-a2b1-f410f4205706" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.752187] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8e2d833-6da9-488a-a2b1-f410f4205706" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.752397] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8e2d833-6da9-488a-a2b1-f410f4205706" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.752586] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.752688] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.752752] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.752957] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.753093] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.753203] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8e2d833-6da9-488a-a2b1-f410f4205706" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.753359] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8e2d833-6da9-488a-a2b1-f410f4205706 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.753491] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8e2d833-6da9-488a-a2b1-f410f4205706" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.753536] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8e2d833-6da9-488a-a2b1-f410f4205706" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.753733] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8e2d833-6da9-488a-a2b1-f410f4205706" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.753894] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.753984] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.754256] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.754461] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.754556] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.754643] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8e2d833-6da9-488a-a2b1-f410f4205706" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.754737] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d8e2d833-6da9-488a-a2b1-f410f4205706',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.957909] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebb204e1-ff28-4709-a165-ad95f8c27d8b in Status: SUCCESS [ 723.958225] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebb204e1-ff28-4709-a165-ad95f8c27d8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.958415] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebb204e1-ff28-4709-a165-ad95f8c27d8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.958637] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebb204e1-ff28-4709-a165-ad95f8c27d8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.958826] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.958948] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.959020] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.959185] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.959253] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.959342] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebb204e1-ff28-4709-a165-ad95f8c27d8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.959438] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ebb204e1-ff28-4709-a165-ad95f8c27d8b',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.961262] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 755f030a-6e7c-43ec-adb9-cb4c270ad532 in Status: SUCCESS [ 723.961600] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.961691] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebb204e1-ff28-4709-a165-ad95f8c27d8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.961927] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebb204e1-ff28-4709-a165-ad95f8c27d8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.962175] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.962325] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.962442] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.962646] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.962785] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.962919] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ebb204e1-ff28-4709-a165-ad95f8c27d8b',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.964429] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.964653] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.964869] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.965907] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.966038] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.966228] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.966567] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.966740] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.967048] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('755f030a-6e7c-43ec-adb9-cb4c270ad532',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.970320] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.970828] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.971101] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.971273] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.971402] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.971596] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.972091] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.972299] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('755f030a-6e7c-43ec-adb9-cb4c270ad532',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.119940] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.120189] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.121204] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.121424] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.121555] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.121752] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5289c470-2cbe-4957-bd37-f39138ab0a31 is going to be updated. [ 724.153817] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.153989] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.154098] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.154371] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.154550] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.165386] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5289c470-2cbe-4957-bd37-f39138ab0a31 in Status: IN_PROGRESS for 2s [ 724.246718] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f3badd2-7106-4670-baaf-51e2d735f908 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.246905] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f3badd2-7106-4670-baaf-51e2d735f908" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.247808] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5f3badd2-7106-4670-baaf-51e2d735f908',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.248817] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3167b3de-faa4-442d-89d7-24525691b3bb with status ACTIVE [ 724.249951] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.249951] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.249951] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.249951] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.249951] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.250247] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.250746] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.250746] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.250746] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.250746] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.251041] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.251041] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.251160] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.251263] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.251303] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.251461] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3167b3de-faa4-442d-89d7-24525691b3bb is going to be updated. [ 724.257963] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d8e2d833-6da9-488a-a2b1-f410f4205706: rpc.has_security_group_logging(os_id): False [ 724.288535] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.288535] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.288535] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.288535] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.288535] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.288535] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.288535] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.288535] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.288535] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.288535] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.288535] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.289164] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.289164] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.290025] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.290025] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.290025] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.290025] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.290025] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.290025] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.290354] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.290354] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d8e2d833-6da9-488a-a2b1-f410f4205706 is going to be updated. [ 724.306842] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.307094] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.307094] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.307287] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.307451] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.307657] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3167b3de-faa4-442d-89d7-24525691b3bb" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.425436] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.425660] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.425771] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.426032] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.426205] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.447169] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d8e2d833-6da9-488a-a2b1-f410f4205706 in Status: IN_PROGRESS for 2s [ 724.473622] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ebb204e1-ff28-4709-a165-ad95f8c27d8b',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.473622] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ebb204e1-ff28-4709-a165-ad95f8c27d8b',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.475774] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-755f030a-6e7c-43ec-adb9-cb4c270ad532 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.476451] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.476792] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('755f030a-6e7c-43ec-adb9-cb4c270ad532',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.538517] env[65337]: INFO networking_nsxv3.common.synchronization [req-3b8cbebe-8404-4128-bab5-a004aa76452b req-5c841c32-4413-4bcd-a2a0-bcd0f3e6ede9 tempest-InstanceActionsV221TestJSON-575592596 tempest-InstanceActionsV221TestJSON-575592596-project-member] Enqueued Resource ID: 8a5daf4d-73bf-4ef2-9c95-5aa4dba6c5c3 with Priority: HIGHEST for action security_group_members [ 724.539352] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a5daf4d-73bf-4ef2-9c95-5aa4dba6c5c3 with Priority: HIGHEST for action security_group_members [ 724.539791] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a5daf4d-73bf-4ef2-9c95-5aa4dba6c5c3 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.540051] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a5daf4d-73bf-4ef2-9c95-5aa4dba6c5c3" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.540519] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a5daf4d-73bf-4ef2-9c95-5aa4dba6c5c3" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.540925] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a5daf4d-73bf-4ef2-9c95-5aa4dba6c5c3" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.541416] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.541416] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.541416] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.541639] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.541687] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.541792] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8a5daf4d-73bf-4ef2-9c95-5aa4dba6c5c3',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.754827] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5f3badd2-7106-4670-baaf-51e2d735f908',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.974690] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ebb204e1-ff28-4709-a165-ad95f8c27d8b: rpc.has_security_group_logging(os_id): False [ 724.976156] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ebb204e1-ff28-4709-a165-ad95f8c27d8b',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.980998] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('755f030a-6e7c-43ec-adb9-cb4c270ad532',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.018263] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.018263] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.018263] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.018263] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.018263] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.018263] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.018263] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.018263] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.018263] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.018263] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.018263] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ebb204e1-ff28-4709-a165-ad95f8c27d8b is going to be created. [ 725.044729] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.044946] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.045145] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.045763] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.045763] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.045908] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.045993] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.046380] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.046380] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.046510] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.046627] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a5daf4d-73bf-4ef2-9c95-5aa4dba6c5c3 already deleted. [ 725.046917] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a5daf4d-73bf-4ef2-9c95-5aa4dba6c5c3" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.087160] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock network-495 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.087450] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "network-495" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.088151] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "network-495" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.088757] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "network-495" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.089604] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.089604] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.089604] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.089857] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.089857] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.090264] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 725.090264] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 725.090395] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 725.090447] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 725.090631] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 725.090631] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 725.090779] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 725.128555] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 725.128851] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Cache value generated in 0.038 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 725.129078] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 725.129341] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "network-495" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.129787] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock port-9ae254ca-6532-42c4-806e-578707f39855 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.130037] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "port-9ae254ca-6532-42c4-806e-578707f39855" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.130543] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "port-9ae254ca-6532-42c4-806e-578707f39855" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.130930] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "port-9ae254ca-6532-42c4-806e-578707f39855" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.131153] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9ae254ca-6532-42c4-806e-578707f39855',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.188258] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.188258] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.188258] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.189263] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.189263] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.220661] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ebb204e1-ff28-4709-a165-ad95f8c27d8b in Status: IN_PROGRESS for 2s [ 725.259376] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.259573] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.259653] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.259842] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.259937] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.260051] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5f3badd2-7106-4670-baaf-51e2d735f908 is going to be created. [ 725.292627] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.292712] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.292795] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.293051] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.293222] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.317431] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f3badd2-7106-4670-baaf-51e2d735f908 in Status: UNINITIALIZED for 2s [ 725.478892] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.479290] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.479290] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.479448] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.479890] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.480037] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ebb204e1-ff28-4709-a165-ad95f8c27d8b is going to be updated. [ 725.485402] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.485402] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.485402] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.485636] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.485636] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.485733] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 755f030a-6e7c-43ec-adb9-cb4c270ad532 is going to be updated. [ 725.557105] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.557105] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.557105] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.557105] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.557105] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.561042] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.561042] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.561042] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.561042] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.561042] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.574571] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebb204e1-ff28-4709-a165-ad95f8c27d8b in Status: IN_PROGRESS for 2s [ 725.574571] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 755f030a-6e7c-43ec-adb9-cb4c270ad532 in Status: IN_PROGRESS for 2s [ 725.638116] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.639193] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.639193] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.639193] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.639193] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.639419] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Segment Port 9ae254ca-6532-42c4-806e-578707f39855 not found, creating... [ 725.639957] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.639957] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.639957] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.640198] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.641568] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.641568] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.641568] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.641568] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.641568] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.641568] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.641568] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Resource: SegmentPort with ID: 9ae254ca-6532-42c4-806e-578707f39855 is going to be created. [ 725.667120] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.667531] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.667756] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.668217] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.668574] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.668882] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "port-9ae254ca-6532-42c4-806e-578707f39855" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.179512] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5289c470-2cbe-4957-bd37-f39138ab0a31 in Status: SUCCESS [ 726.180146] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5289c470-2cbe-4957-bd37-f39138ab0a31" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.180146] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5289c470-2cbe-4957-bd37-f39138ab0a31" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.180146] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5289c470-2cbe-4957-bd37-f39138ab0a31" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.180613] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.180613] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.180613] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.180730] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.180760] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.180862] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5289c470-2cbe-4957-bd37-f39138ab0a31" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.180959] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5289c470-2cbe-4957-bd37-f39138ab0a31',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.464072] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d8e2d833-6da9-488a-a2b1-f410f4205706 in Status: SUCCESS [ 726.464211] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d8e2d833-6da9-488a-a2b1-f410f4205706" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.466969] env[65337]: INFO networking_nsxv3.common.synchronization [req-3b8cbebe-8404-4128-bab5-a004aa76452b req-e35230b9-c3d4-4d8a-a06e-527d34b07764 service nova] Enqueued Resource ID: 8a5daf4d-73bf-4ef2-9c95-5aa4dba6c5c3 with Priority: HIGHEST for action security_group_rules [ 726.467166] env[65337]: INFO networking_nsxv3.common.synchronization [req-3b8cbebe-8404-4128-bab5-a004aa76452b req-e35230b9-c3d4-4d8a-a06e-527d34b07764 service nova] Enqueued Resource ID: 8a5daf4d-73bf-4ef2-9c95-5aa4dba6c5c3 with Priority: HIGHEST for action security_group_members [ 726.467296] env[65337]: INFO networking_nsxv3.common.synchronization [req-3b8cbebe-8404-4128-bab5-a004aa76452b req-e35230b9-c3d4-4d8a-a06e-527d34b07764 service nova] Enqueued Resource ID: 9ae254ca-6532-42c4-806e-578707f39855 with Priority: HIGHEST for action port [ 726.467912] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a5daf4d-73bf-4ef2-9c95-5aa4dba6c5c3 with Priority: HIGHEST for action security_group_rules [ 726.468119] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a5daf4d-73bf-4ef2-9c95-5aa4dba6c5c3 with Priority: HIGHEST for action security_group_members [ 726.468258] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ae254ca-6532-42c4-806e-578707f39855 with Priority: HIGHEST for action port [ 726.468587] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8a5daf4d-73bf-4ef2-9c95-5aa4dba6c5c3 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.468715] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8a5daf4d-73bf-4ef2-9c95-5aa4dba6c5c3" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.468783] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8a5daf4d-73bf-4ef2-9c95-5aa4dba6c5c3" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.469070] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8a5daf4d-73bf-4ef2-9c95-5aa4dba6c5c3" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.469160] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8a5daf4d-73bf-4ef2-9c95-5aa4dba6c5c3',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.470109] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a5daf4d-73bf-4ef2-9c95-5aa4dba6c5c3 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.470255] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a5daf4d-73bf-4ef2-9c95-5aa4dba6c5c3" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.470295] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a5daf4d-73bf-4ef2-9c95-5aa4dba6c5c3" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.470469] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a5daf4d-73bf-4ef2-9c95-5aa4dba6c5c3" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.470951] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.470951] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.470951] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.470951] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.471107] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.471107] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8a5daf4d-73bf-4ef2-9c95-5aa4dba6c5c3',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.472044] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-9ae254ca-6532-42c4-806e-578707f39855 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.472205] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9ae254ca-6532-42c4-806e-578707f39855" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.472274] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9ae254ca-6532-42c4-806e-578707f39855" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.472461] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9ae254ca-6532-42c4-806e-578707f39855" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.472530] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9ae254ca-6532-42c4-806e-578707f39855',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.684885] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5289c470-2cbe-4957-bd37-f39138ab0a31',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.975293] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a5daf4d-73bf-4ef2-9c95-5aa4dba6c5c3 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.975500] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a5daf4d-73bf-4ef2-9c95-5aa4dba6c5c3" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.975650] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8a5daf4d-73bf-4ef2-9c95-5aa4dba6c5c3',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.977263] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9ae254ca-6532-42c4-806e-578707f39855 with status ACTIVE [ 726.977504] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.977704] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.977817] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.978133] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.979398] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.979398] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.979398] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.979398] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.979398] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.979398] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.979398] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.979398] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.979843] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.979843] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.979843] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.979843] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9ae254ca-6532-42c4-806e-578707f39855 is going to be updated. [ 727.014364] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.014595] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.014595] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.014833] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.014939] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.015109] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9ae254ca-6532-42c4-806e-578707f39855" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.186924] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5289c470-2cbe-4957-bd37-f39138ab0a31: rpc.has_security_group_logging(os_id): False [ 727.215375] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.215586] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.215586] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.215860] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.215860] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.218414] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.218414] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.218414] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.218414] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.218414] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.218414] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5289c470-2cbe-4957-bd37-f39138ab0a31 is going to be created. [ 727.231719] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ebb204e1-ff28-4709-a165-ad95f8c27d8b in Status: SUCCESS [ 727.231929] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ebb204e1-ff28-4709-a165-ad95f8c27d8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.232151] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ebb204e1-ff28-4709-a165-ad95f8c27d8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.232366] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ebb204e1-ff28-4709-a165-ad95f8c27d8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.232453] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ebb204e1-ff28-4709-a165-ad95f8c27d8b',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.258325] env[65337]: INFO networking_nsxv3.common.synchronization [req-79689ae0-36c9-4bb6-a4a8-662a6f849dd4 req-a42d0ba6-9520-472b-9d57-e02fc777ddd5 tempest-FloatingIPsAssociationTestJSON-1937565574 tempest-FloatingIPsAssociationTestJSON-1937565574-project-member] Enqueued Resource ID: 3cc33494-7b08-499a-b8bc-a9ae6b25d9d2 with Priority: HIGHEST for action security_group_members [ 727.258908] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cc33494-7b08-499a-b8bc-a9ae6b25d9d2 with Priority: HIGHEST for action security_group_members [ 727.259267] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-3cc33494-7b08-499a-b8bc-a9ae6b25d9d2 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.259409] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3cc33494-7b08-499a-b8bc-a9ae6b25d9d2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.259621] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3cc33494-7b08-499a-b8bc-a9ae6b25d9d2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.259686] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3cc33494-7b08-499a-b8bc-a9ae6b25d9d2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.259811] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.259916] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.260083] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.260640] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.260640] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.260640] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3cc33494-7b08-499a-b8bc-a9ae6b25d9d2',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.283934] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.283934] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.283934] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.283934] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.283934] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.307202] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5289c470-2cbe-4957-bd37-f39138ab0a31 in Status: IN_PROGRESS for 2s [ 727.330758] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f3badd2-7106-4670-baaf-51e2d735f908 in Status: SUCCESS [ 727.330989] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f3badd2-7106-4670-baaf-51e2d735f908" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.331837] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f3badd2-7106-4670-baaf-51e2d735f908" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.332206] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f3badd2-7106-4670-baaf-51e2d735f908" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.332382] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.332537] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.332601] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.332791] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.332791] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.332889] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f3badd2-7106-4670-baaf-51e2d735f908" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.332965] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5f3badd2-7106-4670-baaf-51e2d735f908',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.479027] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8a5daf4d-73bf-4ef2-9c95-5aa4dba6c5c3',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.589231] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebb204e1-ff28-4709-a165-ad95f8c27d8b in Status: SUCCESS [ 727.589231] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebb204e1-ff28-4709-a165-ad95f8c27d8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.589333] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 755f030a-6e7c-43ec-adb9-cb4c270ad532 in Status: SUCCESS [ 727.589539] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.589631] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebb204e1-ff28-4709-a165-ad95f8c27d8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.589833] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebb204e1-ff28-4709-a165-ad95f8c27d8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.590014] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.590141] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.590203] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.590363] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.590470] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.590568] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ebb204e1-ff28-4709-a165-ad95f8c27d8b',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.593852] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.593852] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.593852] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.593852] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.595010] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.595010] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.595010] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.595313] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('755f030a-6e7c-43ec-adb9-cb4c270ad532',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.735110] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebb204e1-ff28-4709-a165-ad95f8c27d8b taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.735110] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebb204e1-ff28-4709-a165-ad95f8c27d8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.763945] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3cc33494-7b08-499a-b8bc-a9ae6b25d9d2',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.802050] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock network-69 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.802334] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "network-69" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.802459] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "network-69" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.802976] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "network-69" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.803283] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.803459] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.803608] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.803834] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.803978] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.804265] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 727.804376] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 727.804489] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 727.804588] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 727.804693] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 727.804791] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 727.805418] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 727.824827] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 727.825140] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 727.825568] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 727.825927] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "network-69" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.826309] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock port-f444a097-0f6d-4609-834c-f0c77d6b9b30 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.826503] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "port-f444a097-0f6d-4609-834c-f0c77d6b9b30" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.826627] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "port-f444a097-0f6d-4609-834c-f0c77d6b9b30" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.826994] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "port-f444a097-0f6d-4609-834c-f0c77d6b9b30" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.827172] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f444a097-0f6d-4609-834c-f0c77d6b9b30',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.835130] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f3badd2-7106-4670-baaf-51e2d735f908 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.835130] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f3badd2-7106-4670-baaf-51e2d735f908" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.835290] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f3badd2-7106-4670-baaf-51e2d735f908" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.838861] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f3badd2-7106-4670-baaf-51e2d735f908" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.838861] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.838861] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.838861] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.838861] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.838861] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.838861] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f3badd2-7106-4670-baaf-51e2d735f908" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.838861] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f3badd2-7106-4670-baaf-51e2d735f908 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.838861] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f3badd2-7106-4670-baaf-51e2d735f908" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.838861] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f3badd2-7106-4670-baaf-51e2d735f908" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.838861] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f3badd2-7106-4670-baaf-51e2d735f908" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.838861] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.838861] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.838861] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.838861] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.838861] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.838861] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f3badd2-7106-4670-baaf-51e2d735f908" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.838861] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5f3badd2-7106-4670-baaf-51e2d735f908',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.983457] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.983673] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.983769] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.984013] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.984146] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.984277] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a5daf4d-73bf-4ef2-9c95-5aa4dba6c5c3 is going to be created. [ 728.018962] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.019192] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.019293] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.019530] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.019688] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.032780] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a5daf4d-73bf-4ef2-9c95-5aa4dba6c5c3 in Status: UNINITIALIZED for 2s [ 728.097486] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ebb204e1-ff28-4709-a165-ad95f8c27d8b',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.098131] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('755f030a-6e7c-43ec-adb9-cb4c270ad532',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.270053] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3cc33494-7b08-499a-b8bc-a9ae6b25d9d2',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.331657] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.331657] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.332044] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.332167] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.332334] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.332489] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Segment Port f444a097-0f6d-4609-834c-f0c77d6b9b30 not found, creating... [ 728.333165] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.333420] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.333553] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.333843] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.334137] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.334429] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.334646] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.334788] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.335018] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.335398] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.335461] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Resource: SegmentPort with ID: f444a097-0f6d-4609-834c-f0c77d6b9b30 is going to be created. [ 728.341020] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5f3badd2-7106-4670-baaf-51e2d735f908: rpc.has_security_group_logging(os_id): False [ 728.361285] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.361800] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.361800] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.362268] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.362569] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.363031] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "port-f444a097-0f6d-4609-834c-f0c77d6b9b30" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.368201] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.369394] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.369394] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.369394] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.369394] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.369394] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.369394] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.369394] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.369789] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.369789] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.369789] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.369789] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.369993] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.370137] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.370137] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.370317] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.370420] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.370475] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.370600] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.370684] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.370768] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5f3badd2-7106-4670-baaf-51e2d735f908 is going to be created. [ 728.462371] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.462544] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.462630] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.462833] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.463045] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.480810] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5f3badd2-7106-4670-baaf-51e2d735f908 in Status: IN_PROGRESS for 2s [ 728.600562] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ebb204e1-ff28-4709-a165-ad95f8c27d8b',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.604785] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('755f030a-6e7c-43ec-adb9-cb4c270ad532',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.773271] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.773271] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.773271] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.773271] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.773512] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.773673] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3cc33494-7b08-499a-b8bc-a9ae6b25d9d2 is going to be updated. [ 728.811378] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.811378] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.811627] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.811662] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.811807] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.822665] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3cc33494-7b08-499a-b8bc-a9ae6b25d9d2 in Status: IN_PROGRESS for 2s [ 729.104329] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.104329] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.104329] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.104329] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.104329] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.104329] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ebb204e1-ff28-4709-a165-ad95f8c27d8b is going to be updated. [ 729.109345] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.109551] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.109651] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.109885] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.110010] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.110204] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 755f030a-6e7c-43ec-adb9-cb4c270ad532 is going to be updated. [ 729.121554] env[65337]: INFO networking_nsxv3.common.synchronization [req-79689ae0-36c9-4bb6-a4a8-662a6f849dd4 req-75b54227-11f9-415c-a924-ccf20ba0637e service nova] Enqueued Resource ID: 3cc33494-7b08-499a-b8bc-a9ae6b25d9d2 with Priority: HIGHEST for action security_group_rules [ 729.121792] env[65337]: INFO networking_nsxv3.common.synchronization [req-79689ae0-36c9-4bb6-a4a8-662a6f849dd4 req-75b54227-11f9-415c-a924-ccf20ba0637e service nova] Enqueued Resource ID: 3cc33494-7b08-499a-b8bc-a9ae6b25d9d2 with Priority: HIGHEST for action security_group_members [ 729.122187] env[65337]: INFO networking_nsxv3.common.synchronization [req-79689ae0-36c9-4bb6-a4a8-662a6f849dd4 req-75b54227-11f9-415c-a924-ccf20ba0637e service nova] Enqueued Resource ID: f444a097-0f6d-4609-834c-f0c77d6b9b30 with Priority: HIGHEST for action port [ 729.122893] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cc33494-7b08-499a-b8bc-a9ae6b25d9d2 with Priority: HIGHEST for action security_group_rules [ 729.123540] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cc33494-7b08-499a-b8bc-a9ae6b25d9d2 with Priority: HIGHEST for action security_group_members [ 729.123706] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f444a097-0f6d-4609-834c-f0c77d6b9b30 with Priority: HIGHEST for action port [ 729.124214] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3cc33494-7b08-499a-b8bc-a9ae6b25d9d2 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.124606] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3cc33494-7b08-499a-b8bc-a9ae6b25d9d2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.124678] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3cc33494-7b08-499a-b8bc-a9ae6b25d9d2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.124915] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3cc33494-7b08-499a-b8bc-a9ae6b25d9d2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.125134] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3cc33494-7b08-499a-b8bc-a9ae6b25d9d2',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.126306] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-3cc33494-7b08-499a-b8bc-a9ae6b25d9d2 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.126470] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3cc33494-7b08-499a-b8bc-a9ae6b25d9d2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.126775] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-f444a097-0f6d-4609-834c-f0c77d6b9b30 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.126946] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f444a097-0f6d-4609-834c-f0c77d6b9b30" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.127052] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f444a097-0f6d-4609-834c-f0c77d6b9b30" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.127363] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f444a097-0f6d-4609-834c-f0c77d6b9b30" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.128036] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f444a097-0f6d-4609-834c-f0c77d6b9b30',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.142371] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.142587] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.142680] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.143489] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.143964] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.146178] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.146251] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.146301] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.146533] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.147342] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.160848] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 755f030a-6e7c-43ec-adb9-cb4c270ad532 in Status: IN_PROGRESS for 2s [ 729.161567] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebb204e1-ff28-4709-a165-ad95f8c27d8b in Status: IN_PROGRESS for 2s [ 729.334104] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5289c470-2cbe-4957-bd37-f39138ab0a31 in Status: SUCCESS [ 729.334538] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5289c470-2cbe-4957-bd37-f39138ab0a31" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.631522] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-3cc33494-7b08-499a-b8bc-a9ae6b25d9d2 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.631671] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3cc33494-7b08-499a-b8bc-a9ae6b25d9d2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.634200] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f444a097-0f6d-4609-834c-f0c77d6b9b30 with status ACTIVE [ 729.634454] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.634602] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.634682] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.634928] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.635072] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.635338] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.635539] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.635539] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.635709] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.635884] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.636038] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.636169] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.636169] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.636392] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.636470] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.636512] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f444a097-0f6d-4609-834c-f0c77d6b9b30 is going to be updated. [ 729.676331] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.676516] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.676599] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.676762] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.676903] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.677101] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f444a097-0f6d-4609-834c-f0c77d6b9b30" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.045242] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a5daf4d-73bf-4ef2-9c95-5aa4dba6c5c3 in Status: SUCCESS [ 730.045472] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a5daf4d-73bf-4ef2-9c95-5aa4dba6c5c3" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.045640] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a5daf4d-73bf-4ef2-9c95-5aa4dba6c5c3" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.045918] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a5daf4d-73bf-4ef2-9c95-5aa4dba6c5c3" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.046131] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.046255] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.046342] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.046511] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.046593] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.046685] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a5daf4d-73bf-4ef2-9c95-5aa4dba6c5c3" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.046763] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8a5daf4d-73bf-4ef2-9c95-5aa4dba6c5c3',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.256237] env[65337]: INFO networking_nsxv3.common.synchronization [req-610be730-ac24-4c38-a2a4-1e5bd482c944 req-46048cc0-6035-4f97-8d1b-a9224ecb3164 tempest-ServersTestBootFromVolume-1626214960 tempest-ServersTestBootFromVolume-1626214960-project-member] Enqueued Resource ID: 4fe2934b-ab8b-4bda-9010-1a9725b2c40c with Priority: HIGHEST for action security_group_members [ 730.256237] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fe2934b-ab8b-4bda-9010-1a9725b2c40c with Priority: HIGHEST for action security_group_members [ 730.256237] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fe2934b-ab8b-4bda-9010-1a9725b2c40c taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.256237] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fe2934b-ab8b-4bda-9010-1a9725b2c40c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.256237] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fe2934b-ab8b-4bda-9010-1a9725b2c40c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.259798] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fe2934b-ab8b-4bda-9010-1a9725b2c40c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.260151] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.260420] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.260573] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.260845] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.261042] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.261411] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4fe2934b-ab8b-4bda-9010-1a9725b2c40c',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.505486] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5f3badd2-7106-4670-baaf-51e2d735f908 in Status: SUCCESS [ 730.509029] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5f3badd2-7106-4670-baaf-51e2d735f908" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.552181] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a5daf4d-73bf-4ef2-9c95-5aa4dba6c5c3 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.552487] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a5daf4d-73bf-4ef2-9c95-5aa4dba6c5c3" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.552573] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a5daf4d-73bf-4ef2-9c95-5aa4dba6c5c3" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.552792] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a5daf4d-73bf-4ef2-9c95-5aa4dba6c5c3" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.552999] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.553150] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.553205] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.553325] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.553448] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.553921] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a5daf4d-73bf-4ef2-9c95-5aa4dba6c5c3" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.554218] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a5daf4d-73bf-4ef2-9c95-5aa4dba6c5c3 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.554294] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a5daf4d-73bf-4ef2-9c95-5aa4dba6c5c3" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.554359] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a5daf4d-73bf-4ef2-9c95-5aa4dba6c5c3" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.554561] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a5daf4d-73bf-4ef2-9c95-5aa4dba6c5c3" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.554723] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.554818] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.554910] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.555106] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.555252] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.555252] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a5daf4d-73bf-4ef2-9c95-5aa4dba6c5c3" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.555345] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8a5daf4d-73bf-4ef2-9c95-5aa4dba6c5c3',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.767828] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.767828] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.767828] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.767828] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.767828] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.767828] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.767828] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.767828] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.767828] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.767828] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.767828] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4fe2934b-ab8b-4bda-9010-1a9725b2c40c already deleted. [ 730.767828] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fe2934b-ab8b-4bda-9010-1a9725b2c40c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.768707] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock network-276 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.768810] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "network-276" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.768972] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "network-276" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.771767] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "network-276" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.771767] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.771767] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.771767] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.773392] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.773392] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.773392] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 730.773392] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 730.773392] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 730.773392] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 730.773392] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 730.773392] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 730.773392] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 730.823597] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 730.823597] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Cache value generated in 0.049 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 730.823597] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 730.823597] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "network-276" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.823979] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock port-dc248bae-12d5-4544-8f31-7a5ad60a3df7 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.824425] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "port-dc248bae-12d5-4544-8f31-7a5ad60a3df7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.824647] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "port-dc248bae-12d5-4544-8f31-7a5ad60a3df7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.825223] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "port-dc248bae-12d5-4544-8f31-7a5ad60a3df7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.825428] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dc248bae-12d5-4544-8f31-7a5ad60a3df7',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.837232] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3cc33494-7b08-499a-b8bc-a9ae6b25d9d2 in Status: SUCCESS [ 730.837602] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3cc33494-7b08-499a-b8bc-a9ae6b25d9d2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.838245] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3cc33494-7b08-499a-b8bc-a9ae6b25d9d2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.838376] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3cc33494-7b08-499a-b8bc-a9ae6b25d9d2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.845431] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.845591] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.849023] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.849023] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.849023] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.849023] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3cc33494-7b08-499a-b8bc-a9ae6b25d9d2',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.057990] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8a5daf4d-73bf-4ef2-9c95-5aa4dba6c5c3: rpc.has_security_group_logging(os_id): False [ 731.077714] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.077902] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.077963] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.078166] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.078249] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.078470] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.078570] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.078627] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.078775] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.078852] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.079040] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.079130] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.079199] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.079325] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.079398] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.079577] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.079669] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.079723] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.079857] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.079929] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.080017] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8a5daf4d-73bf-4ef2-9c95-5aa4dba6c5c3 is going to be created. [ 731.144316] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.144503] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.144571] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.144780] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.145100] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.157391] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8a5daf4d-73bf-4ef2-9c95-5aa4dba6c5c3 in Status: IN_PROGRESS for 2s [ 731.171323] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebb204e1-ff28-4709-a165-ad95f8c27d8b in Status: SUCCESS [ 731.171659] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebb204e1-ff28-4709-a165-ad95f8c27d8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.171848] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebb204e1-ff28-4709-a165-ad95f8c27d8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.172205] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebb204e1-ff28-4709-a165-ad95f8c27d8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.172397] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.172562] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.172623] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.172745] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.172825] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.172907] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebb204e1-ff28-4709-a165-ad95f8c27d8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.173007] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ebb204e1-ff28-4709-a165-ad95f8c27d8b',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.174494] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 755f030a-6e7c-43ec-adb9-cb4c270ad532 in Status: SUCCESS [ 731.174659] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.174808] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.174977] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.175177] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.175293] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.175358] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.175502] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.175582] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.175663] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.175818] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-755f030a-6e7c-43ec-adb9-cb4c270ad532 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.175915] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.175973] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.176125] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.176290] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.176349] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.176409] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.176540] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.176615] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.176750] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.176829] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('755f030a-6e7c-43ec-adb9-cb4c270ad532',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.329835] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.329947] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.330087] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.330400] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.330539] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.330691] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Segment Port dc248bae-12d5-4544-8f31-7a5ad60a3df7 not found, creating... [ 731.330972] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.331200] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.331320] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.331890] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.331890] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.331972] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.332198] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.332289] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.332697] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.332869] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.333087] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Resource: SegmentPort with ID: dc248bae-12d5-4544-8f31-7a5ad60a3df7 is going to be created. [ 731.348169] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3cc33494-7b08-499a-b8bc-a9ae6b25d9d2',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.377605] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.377875] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.377933] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.379342] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.379474] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.379819] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "port-dc248bae-12d5-4544-8f31-7a5ad60a3df7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.609818] env[65337]: INFO networking_nsxv3.common.synchronization [req-fa4605f2-f8a5-4e64-9e90-72da299db9f6 req-0f5cdb4f-6adb-4bf5-8fb2-04cf46dcfb35 tempest-ServerDiskConfigTestJSON-1745593668 tempest-ServerDiskConfigTestJSON-1745593668-project-member] Enqueued Resource ID: 653446ea-2b31-43b8-a920-884274265c75 with Priority: HIGHEST for action security_group_members [ 731.610434] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 653446ea-2b31-43b8-a920-884274265c75 with Priority: HIGHEST for action security_group_members [ 731.610683] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-653446ea-2b31-43b8-a920-884274265c75 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.611130] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.611130] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.611130] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.611283] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.611358] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.611417] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.611550] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.611618] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.611713] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('653446ea-2b31-43b8-a920-884274265c75',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.678708] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ebb204e1-ff28-4709-a165-ad95f8c27d8b',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.679820] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 755f030a-6e7c-43ec-adb9-cb4c270ad532: rpc.has_security_group_logging(os_id): False [ 731.717050] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.717244] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.717301] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.717511] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.717613] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.717859] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.718155] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.718155] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.718155] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.718468] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.718468] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.718468] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.718629] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.718665] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.718859] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.718859] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.719523] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.720228] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.720228] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.720426] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.720532] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 755f030a-6e7c-43ec-adb9-cb4c270ad532 is going to be updated. [ 731.812220] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.812564] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.812564] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.812785] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.813422] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.832899] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 755f030a-6e7c-43ec-adb9-cb4c270ad532 in Status: IN_PROGRESS for 2s [ 731.852253] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3cc33494-7b08-499a-b8bc-a9ae6b25d9d2',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.114096] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.114298] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.114298] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.114426] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.114523] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.114756] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.114883] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.114981] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.115170] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.115256] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.115344] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 653446ea-2b31-43b8-a920-884274265c75 is going to be updated. [ 732.144289] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.144419] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.144488] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.144685] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.144823] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.148780] env[65337]: INFO networking_nsxv3.common.synchronization [req-610be730-ac24-4c38-a2a4-1e5bd482c944 req-47a0755a-a397-46aa-a134-37761a4332a6 service nova] Enqueued Resource ID: 4fe2934b-ab8b-4bda-9010-1a9725b2c40c with Priority: HIGHEST for action security_group_rules [ 732.149031] env[65337]: INFO networking_nsxv3.common.synchronization [req-610be730-ac24-4c38-a2a4-1e5bd482c944 req-47a0755a-a397-46aa-a134-37761a4332a6 service nova] Enqueued Resource ID: 4fe2934b-ab8b-4bda-9010-1a9725b2c40c with Priority: HIGHEST for action security_group_members [ 732.149094] env[65337]: INFO networking_nsxv3.common.synchronization [req-610be730-ac24-4c38-a2a4-1e5bd482c944 req-47a0755a-a397-46aa-a134-37761a4332a6 service nova] Enqueued Resource ID: dc248bae-12d5-4544-8f31-7a5ad60a3df7 with Priority: HIGHEST for action port [ 732.150194] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fe2934b-ab8b-4bda-9010-1a9725b2c40c with Priority: HIGHEST for action security_group_rules [ 732.150194] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fe2934b-ab8b-4bda-9010-1a9725b2c40c with Priority: HIGHEST for action security_group_members [ 732.150194] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc248bae-12d5-4544-8f31-7a5ad60a3df7 with Priority: HIGHEST for action port [ 732.150194] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4fe2934b-ab8b-4bda-9010-1a9725b2c40c taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.150481] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4fe2934b-ab8b-4bda-9010-1a9725b2c40c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.150481] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4fe2934b-ab8b-4bda-9010-1a9725b2c40c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.150733] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4fe2934b-ab8b-4bda-9010-1a9725b2c40c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.150733] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4fe2934b-ab8b-4bda-9010-1a9725b2c40c',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.151560] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fe2934b-ab8b-4bda-9010-1a9725b2c40c taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.151984] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fe2934b-ab8b-4bda-9010-1a9725b2c40c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.151984] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fe2934b-ab8b-4bda-9010-1a9725b2c40c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.151984] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fe2934b-ab8b-4bda-9010-1a9725b2c40c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.152488] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.152488] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.152680] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.152680] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.152734] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.152915] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4fe2934b-ab8b-4bda-9010-1a9725b2c40c',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.154873] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-dc248bae-12d5-4544-8f31-7a5ad60a3df7 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.157064] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dc248bae-12d5-4544-8f31-7a5ad60a3df7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.157064] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dc248bae-12d5-4544-8f31-7a5ad60a3df7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.157064] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dc248bae-12d5-4544-8f31-7a5ad60a3df7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.157064] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dc248bae-12d5-4544-8f31-7a5ad60a3df7',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.158063] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 653446ea-2b31-43b8-a920-884274265c75 in Status: IN_PROGRESS for 2s [ 732.182799] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ebb204e1-ff28-4709-a165-ad95f8c27d8b: rpc.has_security_group_logging(os_id): False [ 732.203481] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.203631] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.203705] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.203913] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.204029] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.204328] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.204402] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.204466] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.204619] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.204698] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.204963] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ebb204e1-ff28-4709-a165-ad95f8c27d8b is going to be updated. [ 732.275256] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.275382] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.275449] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.275746] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.275831] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.299587] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ebb204e1-ff28-4709-a165-ad95f8c27d8b in Status: IN_PROGRESS for 2s [ 732.356857] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.357477] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.357477] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.357800] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.358024] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.359893] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3cc33494-7b08-499a-b8bc-a9ae6b25d9d2 is going to be updated. [ 732.397377] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.397825] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.397825] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.398088] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.398486] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.422178] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3cc33494-7b08-499a-b8bc-a9ae6b25d9d2 in Status: IN_PROGRESS for 2s [ 732.657836] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4fe2934b-ab8b-4bda-9010-1a9725b2c40c',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.658972] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fe2934b-ab8b-4bda-9010-1a9725b2c40c taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.659104] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fe2934b-ab8b-4bda-9010-1a9725b2c40c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.659305] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dc248bae-12d5-4544-8f31-7a5ad60a3df7 with status ACTIVE [ 732.659475] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.659630] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.659758] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.660087] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.660231] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.660481] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.660629] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.660725] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.660955] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.661136] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.661515] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.661705] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.661801] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.662368] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.662368] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.662368] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dc248bae-12d5-4544-8f31-7a5ad60a3df7 is going to be updated. [ 732.697290] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.697519] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.697627] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.697919] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.698173] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.698427] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dc248bae-12d5-4544-8f31-7a5ad60a3df7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.168350] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4fe2934b-ab8b-4bda-9010-1a9725b2c40c',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.175672] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8a5daf4d-73bf-4ef2-9c95-5aa4dba6c5c3 in Status: SUCCESS [ 733.175672] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8a5daf4d-73bf-4ef2-9c95-5aa4dba6c5c3" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.674897] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.675244] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.675244] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.675342] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.675462] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.675557] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4fe2934b-ab8b-4bda-9010-1a9725b2c40c is going to be created. [ 733.729486] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.729660] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.729739] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.730069] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.730204] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.742125] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4fe2934b-ab8b-4bda-9010-1a9725b2c40c in Status: UNINITIALIZED for 2s [ 733.849904] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 755f030a-6e7c-43ec-adb9-cb4c270ad532 in Status: SUCCESS [ 733.850420] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.851155] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.851155] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.851155] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('755f030a-6e7c-43ec-adb9-cb4c270ad532',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.170759] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 653446ea-2b31-43b8-a920-884274265c75 in Status: SUCCESS [ 734.170955] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 653446ea-2b31-43b8-a920-884274265c75 deletion is rescheduled due to dependency. [ 734.171102] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.323104] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ebb204e1-ff28-4709-a165-ad95f8c27d8b in Status: SUCCESS [ 734.323385] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ebb204e1-ff28-4709-a165-ad95f8c27d8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.354732] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-755f030a-6e7c-43ec-adb9-cb4c270ad532 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.354732] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.354894] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.355223] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.355329] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.355455] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.355455] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.355624] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.355727] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.355838] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.355931] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('755f030a-6e7c-43ec-adb9-cb4c270ad532',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.434660] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3cc33494-7b08-499a-b8bc-a9ae6b25d9d2 in Status: SUCCESS [ 734.434852] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3cc33494-7b08-499a-b8bc-a9ae6b25d9d2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.435598] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3cc33494-7b08-499a-b8bc-a9ae6b25d9d2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.435916] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3cc33494-7b08-499a-b8bc-a9ae6b25d9d2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.436260] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.436347] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.436384] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.437322] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.437322] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.437322] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3cc33494-7b08-499a-b8bc-a9ae6b25d9d2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.437322] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3cc33494-7b08-499a-b8bc-a9ae6b25d9d2',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.860107] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-755f030a-6e7c-43ec-adb9-cb4c270ad532 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.860636] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.860636] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.860636] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.860813] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.860883] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.860883] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.861395] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.861395] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.861395] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.861395] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-755f030a-6e7c-43ec-adb9-cb4c270ad532 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.861546] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.861546] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.862220] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.862220] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.862220] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.862220] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.862220] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.862220] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.862519] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.862519] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('755f030a-6e7c-43ec-adb9-cb4c270ad532',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.940461] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-3cc33494-7b08-499a-b8bc-a9ae6b25d9d2 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.940708] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3cc33494-7b08-499a-b8bc-a9ae6b25d9d2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.941062] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3cc33494-7b08-499a-b8bc-a9ae6b25d9d2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.941175] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3cc33494-7b08-499a-b8bc-a9ae6b25d9d2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.941571] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.941571] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.941571] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.942051] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.942502] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.942502] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3cc33494-7b08-499a-b8bc-a9ae6b25d9d2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.942502] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-3cc33494-7b08-499a-b8bc-a9ae6b25d9d2 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.942502] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3cc33494-7b08-499a-b8bc-a9ae6b25d9d2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.942708] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3cc33494-7b08-499a-b8bc-a9ae6b25d9d2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.942708] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3cc33494-7b08-499a-b8bc-a9ae6b25d9d2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.942823] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.944669] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.944669] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.944669] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.944669] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.944669] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3cc33494-7b08-499a-b8bc-a9ae6b25d9d2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.944669] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3cc33494-7b08-499a-b8bc-a9ae6b25d9d2',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.368903] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 755f030a-6e7c-43ec-adb9-cb4c270ad532: rpc.has_security_group_logging(os_id): False [ 735.393601] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.393785] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.398291] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.398563] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.398673] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.398925] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.399067] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.399113] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.399318] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.399318] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.399559] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.399659] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.399725] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.399859] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.399932] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.404352] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.404352] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.404352] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.404352] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.404352] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.404352] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 755f030a-6e7c-43ec-adb9-cb4c270ad532 is going to be updated. [ 735.451343] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3cc33494-7b08-499a-b8bc-a9ae6b25d9d2: rpc.has_security_group_logging(os_id): False [ 735.482042] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.482042] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.482042] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.482042] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.482042] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.482576] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.482576] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.482576] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.482868] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.482933] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.483115] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.483247] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.483321] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.485702] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.485815] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.486205] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.486346] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.486411] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.487766] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.487766] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.487766] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3cc33494-7b08-499a-b8bc-a9ae6b25d9d2 is going to be updated. [ 735.545602] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.545912] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.546081] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.546436] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.546664] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.571381] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 755f030a-6e7c-43ec-adb9-cb4c270ad532 in Status: IN_PROGRESS for 2s [ 735.653600] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.656750] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.656750] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.656750] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.656750] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.682283] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3cc33494-7b08-499a-b8bc-a9ae6b25d9d2 in Status: IN_PROGRESS for 2s [ 735.757875] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4fe2934b-ab8b-4bda-9010-1a9725b2c40c in Status: SUCCESS [ 735.758255] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fe2934b-ab8b-4bda-9010-1a9725b2c40c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.758450] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fe2934b-ab8b-4bda-9010-1a9725b2c40c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.758780] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fe2934b-ab8b-4bda-9010-1a9725b2c40c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.758937] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.758937] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.759281] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.759341] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.759505] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.759579] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fe2934b-ab8b-4bda-9010-1a9725b2c40c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.759635] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4fe2934b-ab8b-4bda-9010-1a9725b2c40c',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.262933] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4fe2934b-ab8b-4bda-9010-1a9725b2c40c',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.765739] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4fe2934b-ab8b-4bda-9010-1a9725b2c40c: rpc.has_security_group_logging(os_id): False [ 736.800725] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.800876] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.800952] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.801351] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.801431] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.801694] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.801834] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.801918] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.802140] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.802230] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.802323] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4fe2934b-ab8b-4bda-9010-1a9725b2c40c is going to be created. [ 737.007646] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.007881] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.007881] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.008159] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.008378] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.031881] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4fe2934b-ab8b-4bda-9010-1a9725b2c40c in Status: IN_PROGRESS for 2s [ 737.151689] env[65337]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 737.151689] env[65337]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=3 [ 737.591796] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 755f030a-6e7c-43ec-adb9-cb4c270ad532 in Status: SUCCESS [ 737.592170] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.699177] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3cc33494-7b08-499a-b8bc-a9ae6b25d9d2 in Status: SUCCESS [ 737.699411] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3cc33494-7b08-499a-b8bc-a9ae6b25d9d2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.861709] env[65337]: INFO networking_nsxv3.common.synchronization [None req-44fb9d95-bb9c-4926-a7ad-9a68eb6f19b1 None None] Enqueued Resource ID: 370311e0-e5cd-4b14-8776-328fdcb73b9e with Priority: HIGHEST for action port [ 738.865584] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 370311e0-e5cd-4b14-8776-328fdcb73b9e with Priority: HIGHEST for action port [ 738.865856] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-370311e0-e5cd-4b14-8776-328fdcb73b9e taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.865983] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-370311e0-e5cd-4b14-8776-328fdcb73b9e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.866064] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-370311e0-e5cd-4b14-8776-328fdcb73b9e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.866315] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-370311e0-e5cd-4b14-8776-328fdcb73b9e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.866403] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('370311e0-e5cd-4b14-8776-328fdcb73b9e',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.046778] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4fe2934b-ab8b-4bda-9010-1a9725b2c40c in Status: SUCCESS [ 739.047014] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4fe2934b-ab8b-4bda-9010-1a9725b2c40c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.370797] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 370311e0-e5cd-4b14-8776-328fdcb73b9e [ 739.370797] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.370797] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.370797] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.370797] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.370797] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.370797] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:370311e0-e5cd-4b14-8776-328fdcb73b9e already deleted. [ 739.370797] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-370311e0-e5cd-4b14-8776-328fdcb73b9e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.724334] env[65337]: INFO networking_nsxv3.common.synchronization [req-dc01f287-e377-4ffc-97aa-f4e547b59f27 req-ba701fdb-bd78-4bd1-8ebe-1860c5b59e43 tempest-InstanceActionsV221TestJSON-575592596 tempest-InstanceActionsV221TestJSON-575592596-project-member] Enqueued Resource ID: 8a5daf4d-73bf-4ef2-9c95-5aa4dba6c5c3 with Priority: HIGHEST for action security_group_members [ 740.725376] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a5daf4d-73bf-4ef2-9c95-5aa4dba6c5c3 with Priority: HIGHEST for action security_group_members [ 740.728314] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a5daf4d-73bf-4ef2-9c95-5aa4dba6c5c3 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.728501] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a5daf4d-73bf-4ef2-9c95-5aa4dba6c5c3" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.730464] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a5daf4d-73bf-4ef2-9c95-5aa4dba6c5c3" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.730464] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a5daf4d-73bf-4ef2-9c95-5aa4dba6c5c3" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.730464] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.730464] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.730464] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.730464] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.730464] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.730464] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8a5daf4d-73bf-4ef2-9c95-5aa4dba6c5c3',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.231753] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.232079] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.232079] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.232385] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.232565] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.232767] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.232767] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.232958] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.233069] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.233069] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.233216] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a5daf4d-73bf-4ef2-9c95-5aa4dba6c5c3 is going to be updated. [ 741.282282] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.282282] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.282282] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.282282] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.282282] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.295123] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a5daf4d-73bf-4ef2-9c95-5aa4dba6c5c3 in Status: IN_PROGRESS for 2s [ 742.244099] env[65337]: INFO networking_nsxv3.common.synchronization [req-66229ff5-9291-4ffd-abf8-639e9ac98ed3 req-6347bf69-7261-4b3a-ac2b-4c6b4d666880 tempest-ServersNegativeTestMultiTenantJSON-1788018303 tempest-ServersNegativeTestMultiTenantJSON-1788018303-project-member] Enqueued Resource ID: 5f3badd2-7106-4670-baaf-51e2d735f908 with Priority: HIGHEST for action security_group_members [ 742.244776] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f3badd2-7106-4670-baaf-51e2d735f908 with Priority: HIGHEST for action security_group_members [ 742.245328] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f3badd2-7106-4670-baaf-51e2d735f908 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.245525] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f3badd2-7106-4670-baaf-51e2d735f908" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.245625] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f3badd2-7106-4670-baaf-51e2d735f908" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.245837] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f3badd2-7106-4670-baaf-51e2d735f908" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.246037] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.246111] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.246163] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.246312] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.246442] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.246501] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5f3badd2-7106-4670-baaf-51e2d735f908',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.750179] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.750417] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.750535] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.750813] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.750928] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.752264] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.752264] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.752264] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.752264] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.752264] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.752264] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5f3badd2-7106-4670-baaf-51e2d735f908 is going to be updated. [ 742.788877] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.788877] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.788877] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.789551] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.789926] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.802223] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f3badd2-7106-4670-baaf-51e2d735f908 in Status: IN_PROGRESS for 2s [ 743.308311] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a5daf4d-73bf-4ef2-9c95-5aa4dba6c5c3 in Status: SUCCESS [ 743.308774] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a5daf4d-73bf-4ef2-9c95-5aa4dba6c5c3 deletion is rescheduled due to dependency. [ 743.308774] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a5daf4d-73bf-4ef2-9c95-5aa4dba6c5c3" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.342051] env[65337]: INFO networking_nsxv3.common.synchronization [None req-7c9e2184-0e93-4f25-bc76-abfce8127367 None None] Enqueued Resource ID: ec6a8328-1db2-43cd-9d0d-9e68f8ff7a6a with Priority: HIGHEST for action port [ 743.342365] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec6a8328-1db2-43cd-9d0d-9e68f8ff7a6a with Priority: HIGHEST for action port [ 743.343279] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-ec6a8328-1db2-43cd-9d0d-9e68f8ff7a6a taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.343279] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ec6a8328-1db2-43cd-9d0d-9e68f8ff7a6a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.343279] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ec6a8328-1db2-43cd-9d0d-9e68f8ff7a6a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.347726] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ec6a8328-1db2-43cd-9d0d-9e68f8ff7a6a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.347726] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ec6a8328-1db2-43cd-9d0d-9e68f8ff7a6a',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.555973] env[65337]: INFO networking_nsxv3.common.synchronization [None req-2a3ed217-4a9a-4c35-a267-2e82505e1683 None None] Enqueued Resource ID: 0c4e7344-83df-411a-9167-0b642992011c with Priority: HIGHEST for action port [ 743.557956] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c4e7344-83df-411a-9167-0b642992011c with Priority: HIGHEST for action port [ 743.558731] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-0c4e7344-83df-411a-9167-0b642992011c taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.558731] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0c4e7344-83df-411a-9167-0b642992011c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.558731] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0c4e7344-83df-411a-9167-0b642992011c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.559666] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0c4e7344-83df-411a-9167-0b642992011c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.559666] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0c4e7344-83df-411a-9167-0b642992011c',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.853913] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ec6a8328-1db2-43cd-9d0d-9e68f8ff7a6a [ 743.854202] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.854341] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.854408] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.854623] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.854708] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.854799] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ec6a8328-1db2-43cd-9d0d-9e68f8ff7a6a already deleted. [ 743.854877] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ec6a8328-1db2-43cd-9d0d-9e68f8ff7a6a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.063718] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0c4e7344-83df-411a-9167-0b642992011c [ 744.063984] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.066331] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.066564] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.066837] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.066938] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.067059] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0c4e7344-83df-411a-9167-0b642992011c already deleted. [ 744.067144] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0c4e7344-83df-411a-9167-0b642992011c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.819024] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f3badd2-7106-4670-baaf-51e2d735f908 in Status: SUCCESS [ 744.819024] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5f3badd2-7106-4670-baaf-51e2d735f908 deletion is rescheduled due to dependency. [ 744.819024] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f3badd2-7106-4670-baaf-51e2d735f908" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.501820] env[65337]: INFO networking_nsxv3.common.synchronization [None req-155e890f-4efe-4385-bbf0-4e8397280753 None None] Enqueued Resource ID: 08b1d57a-ff6f-4cd2-9f84-30b019ac7f87 with Priority: HIGHEST for action port [ 746.502715] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08b1d57a-ff6f-4cd2-9f84-30b019ac7f87 with Priority: HIGHEST for action port [ 746.503214] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-08b1d57a-ff6f-4cd2-9f84-30b019ac7f87 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.503417] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-08b1d57a-ff6f-4cd2-9f84-30b019ac7f87" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.503547] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-08b1d57a-ff6f-4cd2-9f84-30b019ac7f87" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.503917] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-08b1d57a-ff6f-4cd2-9f84-30b019ac7f87" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.504311] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('08b1d57a-ff6f-4cd2-9f84-30b019ac7f87',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.008578] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 08b1d57a-ff6f-4cd2-9f84-30b019ac7f87 [ 747.008786] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.008978] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.009094] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.009350] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.009463] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.009571] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:08b1d57a-ff6f-4cd2-9f84-30b019ac7f87 already deleted. [ 747.009695] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-08b1d57a-ff6f-4cd2-9f84-30b019ac7f87" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.465886] env[65337]: INFO networking_nsxv3.common.synchronization [req-ac7a1a41-1656-4986-af1c-7c53ba876b29 req-2713b1a3-ac80-4eb1-a705-fa43266b0956 tempest-ServerMetadataNegativeTestJSON-900658620 tempest-ServerMetadataNegativeTestJSON-900658620-project-member] Enqueued Resource ID: b5288296-022e-4f32-a68e-bdef9f09be4e with Priority: HIGHEST for action security_group_members [ 748.466625] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5288296-022e-4f32-a68e-bdef9f09be4e with Priority: HIGHEST for action security_group_members [ 748.466991] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5288296-022e-4f32-a68e-bdef9f09be4e taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.467335] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5288296-022e-4f32-a68e-bdef9f09be4e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.467430] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5288296-022e-4f32-a68e-bdef9f09be4e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.467753] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5288296-022e-4f32-a68e-bdef9f09be4e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.467976] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.468107] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.468174] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.468366] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.468495] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.468658] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b5288296-022e-4f32-a68e-bdef9f09be4e',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.826378] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock network-305 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.826633] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "network-305" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.826819] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "network-305" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.827157] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "network-305" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.827486] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.827730] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.827977] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.828104] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.828354] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.828563] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 748.828679] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 748.828796] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 748.828900] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 748.829035] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 748.829176] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 748.829310] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 748.853190] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 748.853367] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 748.853421] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 748.853626] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "network-305" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.853978] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock port-e47069ae-161e-468e-8810-12b6f65c0c9c taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.854245] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "port-e47069ae-161e-468e-8810-12b6f65c0c9c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.854389] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "port-e47069ae-161e-468e-8810-12b6f65c0c9c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.854764] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "port-e47069ae-161e-468e-8810-12b6f65c0c9c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.854923] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e47069ae-161e-468e-8810-12b6f65c0c9c',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.971324] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.971535] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.971535] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.971805] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.971950] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.972260] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.972351] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.972351] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.972557] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.972660] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.972889] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b5288296-022e-4f32-a68e-bdef9f09be4e already deleted. [ 748.972889] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5288296-022e-4f32-a68e-bdef9f09be4e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.357687] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.357932] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.358041] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.358348] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.358498] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.358646] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Segment Port e47069ae-161e-468e-8810-12b6f65c0c9c not found, creating... [ 749.358941] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.359073] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.359189] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.359537] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.359698] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.359982] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.360221] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.360353] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.360570] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.360797] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.360943] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Resource: SegmentPort with ID: e47069ae-161e-468e-8810-12b6f65c0c9c is going to be created. [ 749.387634] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.387891] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.387944] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.388285] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.388547] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.388766] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "port-e47069ae-161e-468e-8810-12b6f65c0c9c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.121115] env[65337]: INFO networking_nsxv3.common.synchronization [req-ac7a1a41-1656-4986-af1c-7c53ba876b29 req-427a2b9e-1c28-4fb1-b1df-30f68f67d331 service nova] Enqueued Resource ID: b5288296-022e-4f32-a68e-bdef9f09be4e with Priority: HIGHEST for action security_group_rules [ 750.121410] env[65337]: INFO networking_nsxv3.common.synchronization [req-ac7a1a41-1656-4986-af1c-7c53ba876b29 req-427a2b9e-1c28-4fb1-b1df-30f68f67d331 service nova] Enqueued Resource ID: b5288296-022e-4f32-a68e-bdef9f09be4e with Priority: HIGHEST for action security_group_members [ 750.121536] env[65337]: INFO networking_nsxv3.common.synchronization [req-ac7a1a41-1656-4986-af1c-7c53ba876b29 req-427a2b9e-1c28-4fb1-b1df-30f68f67d331 service nova] Enqueued Resource ID: e47069ae-161e-468e-8810-12b6f65c0c9c with Priority: HIGHEST for action port [ 750.122246] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5288296-022e-4f32-a68e-bdef9f09be4e with Priority: HIGHEST for action security_group_rules [ 750.122398] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5288296-022e-4f32-a68e-bdef9f09be4e with Priority: HIGHEST for action security_group_members [ 750.122497] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e47069ae-161e-468e-8810-12b6f65c0c9c with Priority: HIGHEST for action port [ 750.122798] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b5288296-022e-4f32-a68e-bdef9f09be4e taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.122924] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b5288296-022e-4f32-a68e-bdef9f09be4e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.122987] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b5288296-022e-4f32-a68e-bdef9f09be4e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.123264] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b5288296-022e-4f32-a68e-bdef9f09be4e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.123352] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b5288296-022e-4f32-a68e-bdef9f09be4e',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.124398] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5288296-022e-4f32-a68e-bdef9f09be4e taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.124527] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5288296-022e-4f32-a68e-bdef9f09be4e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.124622] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5288296-022e-4f32-a68e-bdef9f09be4e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.124815] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5288296-022e-4f32-a68e-bdef9f09be4e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.124995] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.125145] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.125214] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.125374] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.125479] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.125574] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b5288296-022e-4f32-a68e-bdef9f09be4e',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.126616] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-e47069ae-161e-468e-8810-12b6f65c0c9c taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.126788] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e47069ae-161e-468e-8810-12b6f65c0c9c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.126788] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e47069ae-161e-468e-8810-12b6f65c0c9c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.126949] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e47069ae-161e-468e-8810-12b6f65c0c9c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.127144] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e47069ae-161e-468e-8810-12b6f65c0c9c',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.629447] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b5288296-022e-4f32-a68e-bdef9f09be4e',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.631081] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5288296-022e-4f32-a68e-bdef9f09be4e taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.631295] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5288296-022e-4f32-a68e-bdef9f09be4e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.631371] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e47069ae-161e-468e-8810-12b6f65c0c9c with status ACTIVE [ 750.631606] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.631699] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.631794] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.631986] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.632233] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.632447] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.632601] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.632701] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.632917] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.633033] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.633310] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.633463] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.633515] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.633686] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.633784] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.633902] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e47069ae-161e-468e-8810-12b6f65c0c9c is going to be updated. [ 750.664660] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.664948] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.664948] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.665221] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.665398] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.665626] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e47069ae-161e-468e-8810-12b6f65c0c9c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.113055] env[65337]: INFO networking_nsxv3.common.synchronization [req-21c6f32a-d9ef-40c2-b4fd-c936fefb1679 req-38ee1af0-2291-4a2a-9fec-c7cac5c9df9e tempest-ServersWithSpecificFlavorTestJSON-1708740375 tempest-ServersWithSpecificFlavorTestJSON-1708740375-project-member] Enqueued Resource ID: c26a679a-9c5d-4a72-b91b-bd7f21348ea0 with Priority: HIGHEST for action security_group_members [ 751.113632] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c26a679a-9c5d-4a72-b91b-bd7f21348ea0 with Priority: HIGHEST for action security_group_members [ 751.113957] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-c26a679a-9c5d-4a72-b91b-bd7f21348ea0 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.114344] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c26a679a-9c5d-4a72-b91b-bd7f21348ea0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.114424] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c26a679a-9c5d-4a72-b91b-bd7f21348ea0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.115449] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c26a679a-9c5d-4a72-b91b-bd7f21348ea0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.115633] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.115745] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.115807] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.115998] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.116099] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.116196] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c26a679a-9c5d-4a72-b91b-bd7f21348ea0',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.135982] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b5288296-022e-4f32-a68e-bdef9f09be4e',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.429518] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock network-976 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.429742] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "network-976" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.429857] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "network-976" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.430129] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "network-976" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.430404] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.430554] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.430660] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.430884] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.431173] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.431422] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 751.431535] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 751.431725] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 751.431853] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 751.431939] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 751.432497] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 751.432497] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 751.452195] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 751.452382] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 751.452539] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 751.452716] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "network-976" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.453085] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock port-49fe85bd-9ca6-46d6-adca-7099ce929d4b taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.453257] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "port-49fe85bd-9ca6-46d6-adca-7099ce929d4b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.453372] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "port-49fe85bd-9ca6-46d6-adca-7099ce929d4b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.453716] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "port-49fe85bd-9ca6-46d6-adca-7099ce929d4b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.453849] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('49fe85bd-9ca6-46d6-adca-7099ce929d4b',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.621130] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.621307] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.621373] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.621609] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.621712] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.621923] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.622073] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.622174] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.622305] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.622403] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.622478] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c26a679a-9c5d-4a72-b91b-bd7f21348ea0 is going to be updated. [ 751.638209] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.638466] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.638514] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.638766] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.638886] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.639034] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b5288296-022e-4f32-a68e-bdef9f09be4e is going to be created. [ 751.653992] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.654260] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.654343] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.654576] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.654736] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.667075] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c26a679a-9c5d-4a72-b91b-bd7f21348ea0 in Status: IN_PROGRESS for 2s [ 751.670208] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.670427] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.670427] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.670714] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.670917] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.680484] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5288296-022e-4f32-a68e-bdef9f09be4e in Status: UNINITIALIZED for 2s [ 751.957144] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.957372] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.957528] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.957822] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.958012] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.958175] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Segment Port 49fe85bd-9ca6-46d6-adca-7099ce929d4b not found, creating... [ 751.958486] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.958672] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.958782] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.959012] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.959159] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.959443] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.959604] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.959714] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.959913] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.960046] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.960526] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Resource: SegmentPort with ID: 49fe85bd-9ca6-46d6-adca-7099ce929d4b is going to be created. [ 751.987853] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.988215] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.988505] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.988730] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.988972] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.989257] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "port-49fe85bd-9ca6-46d6-adca-7099ce929d4b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.717167] env[65337]: INFO networking_nsxv3.common.synchronization [req-21c6f32a-d9ef-40c2-b4fd-c936fefb1679 req-7d69b2a1-44c0-4e27-b260-0580f55ad7a7 service nova] Enqueued Resource ID: c26a679a-9c5d-4a72-b91b-bd7f21348ea0 with Priority: HIGHEST for action security_group_rules [ 752.717847] env[65337]: INFO networking_nsxv3.common.synchronization [req-21c6f32a-d9ef-40c2-b4fd-c936fefb1679 req-7d69b2a1-44c0-4e27-b260-0580f55ad7a7 service nova] Enqueued Resource ID: c26a679a-9c5d-4a72-b91b-bd7f21348ea0 with Priority: HIGHEST for action security_group_members [ 752.719154] env[65337]: INFO networking_nsxv3.common.synchronization [req-21c6f32a-d9ef-40c2-b4fd-c936fefb1679 req-7d69b2a1-44c0-4e27-b260-0580f55ad7a7 service nova] Enqueued Resource ID: 49fe85bd-9ca6-46d6-adca-7099ce929d4b with Priority: HIGHEST for action port [ 752.719154] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c26a679a-9c5d-4a72-b91b-bd7f21348ea0 with Priority: HIGHEST for action security_group_rules [ 752.719294] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c26a679a-9c5d-4a72-b91b-bd7f21348ea0 with Priority: HIGHEST for action security_group_members [ 752.719294] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49fe85bd-9ca6-46d6-adca-7099ce929d4b with Priority: HIGHEST for action port [ 752.719754] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c26a679a-9c5d-4a72-b91b-bd7f21348ea0 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.719754] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c26a679a-9c5d-4a72-b91b-bd7f21348ea0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.719754] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c26a679a-9c5d-4a72-b91b-bd7f21348ea0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.719942] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c26a679a-9c5d-4a72-b91b-bd7f21348ea0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.719992] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c26a679a-9c5d-4a72-b91b-bd7f21348ea0',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.721193] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-c26a679a-9c5d-4a72-b91b-bd7f21348ea0 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.721193] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c26a679a-9c5d-4a72-b91b-bd7f21348ea0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.721365] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-49fe85bd-9ca6-46d6-adca-7099ce929d4b taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.721423] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-49fe85bd-9ca6-46d6-adca-7099ce929d4b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.721496] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-49fe85bd-9ca6-46d6-adca-7099ce929d4b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.721657] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-49fe85bd-9ca6-46d6-adca-7099ce929d4b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.721769] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('49fe85bd-9ca6-46d6-adca-7099ce929d4b',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.227434] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 49fe85bd-9ca6-46d6-adca-7099ce929d4b with status ACTIVE [ 753.227671] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.227816] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.227880] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.228154] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.228512] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.228512] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.228700] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.228700] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.228803] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.228914] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.229149] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.229149] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.229233] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.229339] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.229406] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.229495] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 49fe85bd-9ca6-46d6-adca-7099ce929d4b is going to be updated. [ 753.230673] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-c26a679a-9c5d-4a72-b91b-bd7f21348ea0 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.230864] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c26a679a-9c5d-4a72-b91b-bd7f21348ea0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.255386] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.255589] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.255642] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.255846] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.255981] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.256160] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-49fe85bd-9ca6-46d6-adca-7099ce929d4b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.680042] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c26a679a-9c5d-4a72-b91b-bd7f21348ea0 in Status: SUCCESS [ 753.680042] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c26a679a-9c5d-4a72-b91b-bd7f21348ea0 deletion is rescheduled due to dependency. [ 753.680042] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c26a679a-9c5d-4a72-b91b-bd7f21348ea0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.680042] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c26a679a-9c5d-4a72-b91b-bd7f21348ea0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.680042] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c26a679a-9c5d-4a72-b91b-bd7f21348ea0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.680042] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.680042] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.680042] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.680455] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.680455] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.680455] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c26a679a-9c5d-4a72-b91b-bd7f21348ea0',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.690450] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5288296-022e-4f32-a68e-bdef9f09be4e in Status: SUCCESS [ 753.690670] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5288296-022e-4f32-a68e-bdef9f09be4e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.691161] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5288296-022e-4f32-a68e-bdef9f09be4e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.691418] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5288296-022e-4f32-a68e-bdef9f09be4e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.691619] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.691993] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.691993] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.691993] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.691993] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.692187] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5288296-022e-4f32-a68e-bdef9f09be4e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.692217] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b5288296-022e-4f32-a68e-bdef9f09be4e',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.183430] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c26a679a-9c5d-4a72-b91b-bd7f21348ea0',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.194241] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5288296-022e-4f32-a68e-bdef9f09be4e taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.194695] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5288296-022e-4f32-a68e-bdef9f09be4e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.194695] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5288296-022e-4f32-a68e-bdef9f09be4e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.194978] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5288296-022e-4f32-a68e-bdef9f09be4e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.195404] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.195404] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.195404] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.195733] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.195733] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.195810] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5288296-022e-4f32-a68e-bdef9f09be4e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.195945] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5288296-022e-4f32-a68e-bdef9f09be4e taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.196075] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5288296-022e-4f32-a68e-bdef9f09be4e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.196161] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5288296-022e-4f32-a68e-bdef9f09be4e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.196343] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5288296-022e-4f32-a68e-bdef9f09be4e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.196521] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.196644] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.196705] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.196874] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.196959] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.197081] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5288296-022e-4f32-a68e-bdef9f09be4e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.197193] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b5288296-022e-4f32-a68e-bdef9f09be4e',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.686977] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c26a679a-9c5d-4a72-b91b-bd7f21348ea0',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.700076] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b5288296-022e-4f32-a68e-bdef9f09be4e: rpc.has_security_group_logging(os_id): False [ 754.721695] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.722507] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.722507] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.722507] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.722507] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.722778] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.722778] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.722909] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.722957] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.723110] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.723252] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.723435] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.723507] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.723616] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.723781] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.723969] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.724626] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.724626] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.724747] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.724828] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.724963] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b5288296-022e-4f32-a68e-bdef9f09be4e is going to be created. [ 754.811315] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.811525] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.811592] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.812363] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.812631] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.830193] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b5288296-022e-4f32-a68e-bdef9f09be4e in Status: IN_PROGRESS for 2s [ 755.191214] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.191677] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.191677] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.191798] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.193230] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.193230] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c26a679a-9c5d-4a72-b91b-bd7f21348ea0 is going to be updated. [ 755.238111] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.238314] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.238417] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.239034] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.239034] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.254981] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c26a679a-9c5d-4a72-b91b-bd7f21348ea0 in Status: IN_PROGRESS for 2s [ 756.834352] env[65337]: INFO networking_nsxv3.common.synchronization [req-a34c964f-49f2-4440-a076-0dd8602e994f req-28e70822-cdae-4370-9f41-b594b5728289 tempest-AttachInterfacesTestJSON-1783062477 tempest-AttachInterfacesTestJSON-1783062477-project-member] Enqueued Resource ID: 94a13e53-dcf7-4643-ade4-8789dc9eabc4 with Priority: HIGHEST for action security_group_members [ 756.835390] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94a13e53-dcf7-4643-ade4-8789dc9eabc4 with Priority: HIGHEST for action security_group_members [ 756.836250] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-94a13e53-dcf7-4643-ade4-8789dc9eabc4 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.836572] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.836572] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.836796] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.836988] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.837163] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.837218] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.837509] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.837509] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.837509] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('94a13e53-dcf7-4643-ade4-8789dc9eabc4',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.848819] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b5288296-022e-4f32-a68e-bdef9f09be4e in Status: SUCCESS [ 756.849617] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b5288296-022e-4f32-a68e-bdef9f09be4e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.229201] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock network-250 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.229201] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "network-250" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.229201] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "network-250" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.229201] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "network-250" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.231031] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.231428] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.231717] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.232129] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.232513] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.232909] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 757.233162] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 757.234284] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 757.234284] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 757.234284] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 757.234284] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 757.234284] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 757.255561] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 757.255748] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 757.255859] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 757.256046] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "network-250" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.256539] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock port-f6eff944-5baf-4f8e-91ff-075d1f7a1abf taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.256721] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "port-f6eff944-5baf-4f8e-91ff-075d1f7a1abf" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.256839] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "port-f6eff944-5baf-4f8e-91ff-075d1f7a1abf" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.257514] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "port-f6eff944-5baf-4f8e-91ff-075d1f7a1abf" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.257514] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f6eff944-5baf-4f8e-91ff-075d1f7a1abf',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.267930] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c26a679a-9c5d-4a72-b91b-bd7f21348ea0 in Status: SUCCESS [ 757.268436] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c26a679a-9c5d-4a72-b91b-bd7f21348ea0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.268687] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c26a679a-9c5d-4a72-b91b-bd7f21348ea0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.268894] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c26a679a-9c5d-4a72-b91b-bd7f21348ea0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.269106] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.269236] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.269295] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.269442] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.269747] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.269747] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c26a679a-9c5d-4a72-b91b-bd7f21348ea0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.269747] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c26a679a-9c5d-4a72-b91b-bd7f21348ea0',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.340623] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.340862] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.340965] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.341331] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.341519] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.341700] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.341833] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.341912] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.342145] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.342230] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.342345] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 94a13e53-dcf7-4643-ade4-8789dc9eabc4 already deleted. [ 757.342437] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.761307] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.761307] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.761524] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.761786] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.761954] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.762256] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Segment Port f6eff944-5baf-4f8e-91ff-075d1f7a1abf not found, creating... [ 757.762476] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.762654] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.762775] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.763044] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.763163] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.763458] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.763625] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.763733] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.763950] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.764122] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.764309] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Resource: SegmentPort with ID: f6eff944-5baf-4f8e-91ff-075d1f7a1abf is going to be created. [ 757.772234] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c26a679a-9c5d-4a72-b91b-bd7f21348ea0',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.785512] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.785752] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.785849] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.786119] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.786340] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.786556] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "port-f6eff944-5baf-4f8e-91ff-075d1f7a1abf" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.274992] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c26a679a-9c5d-4a72-b91b-bd7f21348ea0: rpc.has_security_group_logging(os_id): False [ 758.300355] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.300486] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.301045] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.301045] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.301045] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.301261] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.301364] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.301364] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.301530] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.301605] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.301673] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c26a679a-9c5d-4a72-b91b-bd7f21348ea0 is going to be updated. [ 758.369826] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.369985] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.370063] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.370271] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.370428] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.383342] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c26a679a-9c5d-4a72-b91b-bd7f21348ea0 in Status: IN_PROGRESS for 2s [ 758.516912] env[65337]: INFO networking_nsxv3.common.synchronization [req-a34c964f-49f2-4440-a076-0dd8602e994f req-19e5aec3-cb5e-4e2e-a074-f340cc3b0579 service nova] Enqueued Resource ID: 94a13e53-dcf7-4643-ade4-8789dc9eabc4 with Priority: HIGHEST for action security_group_rules [ 758.517324] env[65337]: INFO networking_nsxv3.common.synchronization [req-a34c964f-49f2-4440-a076-0dd8602e994f req-19e5aec3-cb5e-4e2e-a074-f340cc3b0579 service nova] Enqueued Resource ID: 94a13e53-dcf7-4643-ade4-8789dc9eabc4 with Priority: HIGHEST for action security_group_members [ 758.517838] env[65337]: INFO networking_nsxv3.common.synchronization [req-a34c964f-49f2-4440-a076-0dd8602e994f req-19e5aec3-cb5e-4e2e-a074-f340cc3b0579 service nova] Enqueued Resource ID: f6eff944-5baf-4f8e-91ff-075d1f7a1abf with Priority: HIGHEST for action port [ 758.518674] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94a13e53-dcf7-4643-ade4-8789dc9eabc4 with Priority: HIGHEST for action security_group_rules [ 758.519026] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94a13e53-dcf7-4643-ade4-8789dc9eabc4 with Priority: HIGHEST for action security_group_members [ 758.519339] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6eff944-5baf-4f8e-91ff-075d1f7a1abf with Priority: HIGHEST for action port [ 758.519925] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-94a13e53-dcf7-4643-ade4-8789dc9eabc4 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.520235] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.520955] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.520955] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.521231] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('94a13e53-dcf7-4643-ade4-8789dc9eabc4',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.523113] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-94a13e53-dcf7-4643-ade4-8789dc9eabc4 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.523398] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.523568] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.523857] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.524122] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.524386] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.524540] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.524781] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.527019] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.527019] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('94a13e53-dcf7-4643-ade4-8789dc9eabc4',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.527019] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-f6eff944-5baf-4f8e-91ff-075d1f7a1abf taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.527019] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f6eff944-5baf-4f8e-91ff-075d1f7a1abf" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.527019] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f6eff944-5baf-4f8e-91ff-075d1f7a1abf" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.527019] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f6eff944-5baf-4f8e-91ff-075d1f7a1abf" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.527019] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f6eff944-5baf-4f8e-91ff-075d1f7a1abf',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.709195] env[65337]: INFO networking_nsxv3.common.synchronization [req-6e6d9f20-59f8-4c30-9837-b89cd5a1cc09 req-cb5cfab5-eb39-4328-8a12-61f75be1cdfe tempest-FloatingIPsAssociationTestJSON-1937565574 tempest-FloatingIPsAssociationTestJSON-1937565574-project-member] Enqueued Resource ID: 3cc33494-7b08-499a-b8bc-a9ae6b25d9d2 with Priority: HIGHEST for action security_group_members [ 758.709195] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cc33494-7b08-499a-b8bc-a9ae6b25d9d2 with Priority: HIGHEST for action security_group_members [ 758.709195] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-3cc33494-7b08-499a-b8bc-a9ae6b25d9d2 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.709195] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3cc33494-7b08-499a-b8bc-a9ae6b25d9d2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.709195] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3cc33494-7b08-499a-b8bc-a9ae6b25d9d2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.709195] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3cc33494-7b08-499a-b8bc-a9ae6b25d9d2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.709195] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.709195] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.709195] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.709823] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.710038] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.711666] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3cc33494-7b08-499a-b8bc-a9ae6b25d9d2',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.029563] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('94a13e53-dcf7-4643-ade4-8789dc9eabc4',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.031117] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f6eff944-5baf-4f8e-91ff-075d1f7a1abf with status ACTIVE [ 759.031304] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.031467] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.031521] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.031700] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.031787] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.032048] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.032048] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.032179] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.032326] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.032770] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.032847] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.032905] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.032968] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.033150] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.033220] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.033269] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f6eff944-5baf-4f8e-91ff-075d1f7a1abf is going to be updated. [ 759.034416] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-94a13e53-dcf7-4643-ade4-8789dc9eabc4 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.034581] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.056098] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.056275] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.056320] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.056553] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.056698] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.056859] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f6eff944-5baf-4f8e-91ff-075d1f7a1abf" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.218187] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3cc33494-7b08-499a-b8bc-a9ae6b25d9d2',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.532391] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('94a13e53-dcf7-4643-ade4-8789dc9eabc4',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.720177] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3cc33494-7b08-499a-b8bc-a9ae6b25d9d2',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.035523] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.035754] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.036089] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.036089] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.036239] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.036239] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 94a13e53-dcf7-4643-ade4-8789dc9eabc4 is going to be created. [ 760.061946] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.062177] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.062177] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.062471] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.062661] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.073531] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94a13e53-dcf7-4643-ade4-8789dc9eabc4 in Status: UNINITIALIZED for 2s [ 760.223504] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.223710] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.223756] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.225023] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.225023] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.225023] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3cc33494-7b08-499a-b8bc-a9ae6b25d9d2 is going to be updated. [ 760.270497] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.270657] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.270728] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.270950] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.271141] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.282707] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3cc33494-7b08-499a-b8bc-a9ae6b25d9d2 in Status: IN_PROGRESS for 2s [ 760.396542] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c26a679a-9c5d-4a72-b91b-bd7f21348ea0 in Status: SUCCESS [ 760.396829] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c26a679a-9c5d-4a72-b91b-bd7f21348ea0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.653325] env[65337]: INFO networking_nsxv3.common.synchronization [req-f6865d48-f158-4253-acbe-45f159fccf24 req-e4be1d67-3841-4506-8401-08a610ab7405 tempest-FloatingIPsAssociationNegativeTestJSON-108411543 tempest-FloatingIPsAssociationNegativeTestJSON-108411543-project-member] Enqueued Resource ID: 88540781-e606-4e3c-87fb-e6581cf39d0d with Priority: HIGHEST for action security_group_members [ 760.654088] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88540781-e606-4e3c-87fb-e6581cf39d0d with Priority: HIGHEST for action security_group_members [ 760.654404] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-88540781-e606-4e3c-87fb-e6581cf39d0d taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.654550] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88540781-e606-4e3c-87fb-e6581cf39d0d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.654625] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88540781-e606-4e3c-87fb-e6581cf39d0d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.654953] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88540781-e606-4e3c-87fb-e6581cf39d0d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.655041] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.655122] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.655183] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.655377] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.655500] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.655645] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('88540781-e606-4e3c-87fb-e6581cf39d0d',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.076649] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock network-165 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.077701] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "network-165" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.077701] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "network-165" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.077701] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "network-165" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.077701] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.077701] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.077957] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.077957] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.078115] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.078366] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 761.078446] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 761.078545] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 761.078642] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 761.079270] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 761.079270] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 761.079270] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 761.098114] env[65337]: INFO networking_nsxv3.common.synchronization [None req-4db3cee8-8738-4b1f-9f00-52590378ef9f None None] Enqueued Resource ID: f6ee69c6-4746-4a00-b0d1-a7fcc6e9aa01 with Priority: HIGHEST for action port [ 761.098576] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6ee69c6-4746-4a00-b0d1-a7fcc6e9aa01 with Priority: HIGHEST for action port [ 761.099971] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 761.100189] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 761.100249] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 761.100402] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "network-165" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.101237] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock port-86c0c3f8-cd60-4f4c-b69c-1c66eff8121e taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.101237] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "port-86c0c3f8-cd60-4f4c-b69c-1c66eff8121e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.101237] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "port-86c0c3f8-cd60-4f4c-b69c-1c66eff8121e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.101448] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "port-86c0c3f8-cd60-4f4c-b69c-1c66eff8121e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.101448] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('86c0c3f8-cd60-4f4c-b69c-1c66eff8121e',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.102543] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-f6ee69c6-4746-4a00-b0d1-a7fcc6e9aa01 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.102666] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f6ee69c6-4746-4a00-b0d1-a7fcc6e9aa01" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.102734] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f6ee69c6-4746-4a00-b0d1-a7fcc6e9aa01" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.102960] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f6ee69c6-4746-4a00-b0d1-a7fcc6e9aa01" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.103044] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f6ee69c6-4746-4a00-b0d1-a7fcc6e9aa01',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.157941] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.158127] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.158360] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.158483] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.158579] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.158786] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.158887] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.158950] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.159801] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.159801] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.159801] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88540781-e606-4e3c-87fb-e6581cf39d0d already deleted. [ 761.159801] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88540781-e606-4e3c-87fb-e6581cf39d0d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.605813] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.606113] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.606188] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.606442] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.606585] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.606733] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Segment Port 86c0c3f8-cd60-4f4c-b69c-1c66eff8121e not found, creating... [ 761.607046] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.607211] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.607310] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.607523] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.607657] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.608039] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.608173] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.608291] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.608456] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.608591] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.608721] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Resource: SegmentPort with ID: 86c0c3f8-cd60-4f4c-b69c-1c66eff8121e is going to be created. [ 761.609915] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f6ee69c6-4746-4a00-b0d1-a7fcc6e9aa01 [ 761.610144] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.610227] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.610302] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.610433] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.610567] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.610662] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f6ee69c6-4746-4a00-b0d1-a7fcc6e9aa01 already deleted. [ 761.610662] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f6ee69c6-4746-4a00-b0d1-a7fcc6e9aa01" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.642580] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.642580] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.642580] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.642580] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.642580] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.642580] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "port-86c0c3f8-cd60-4f4c-b69c-1c66eff8121e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.086275] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94a13e53-dcf7-4643-ade4-8789dc9eabc4 in Status: SUCCESS [ 762.086693] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.086871] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.087102] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.087301] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.087450] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.087552] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.087630] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.087710] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.087798] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.087883] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('94a13e53-dcf7-4643-ade4-8789dc9eabc4',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.303738] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3cc33494-7b08-499a-b8bc-a9ae6b25d9d2 in Status: SUCCESS [ 762.304500] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3cc33494-7b08-499a-b8bc-a9ae6b25d9d2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.349160] env[65337]: INFO networking_nsxv3.common.synchronization [req-f6865d48-f158-4253-acbe-45f159fccf24 req-656e5a18-f2db-4cab-bcef-dcd97e3636a4 service nova] Enqueued Resource ID: 88540781-e606-4e3c-87fb-e6581cf39d0d with Priority: HIGHEST for action security_group_rules [ 762.349342] env[65337]: INFO networking_nsxv3.common.synchronization [req-f6865d48-f158-4253-acbe-45f159fccf24 req-656e5a18-f2db-4cab-bcef-dcd97e3636a4 service nova] Enqueued Resource ID: 88540781-e606-4e3c-87fb-e6581cf39d0d with Priority: HIGHEST for action security_group_members [ 762.349501] env[65337]: INFO networking_nsxv3.common.synchronization [req-f6865d48-f158-4253-acbe-45f159fccf24 req-656e5a18-f2db-4cab-bcef-dcd97e3636a4 service nova] Enqueued Resource ID: 86c0c3f8-cd60-4f4c-b69c-1c66eff8121e with Priority: HIGHEST for action port [ 762.350161] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88540781-e606-4e3c-87fb-e6581cf39d0d with Priority: HIGHEST for action security_group_rules [ 762.350390] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88540781-e606-4e3c-87fb-e6581cf39d0d with Priority: HIGHEST for action security_group_members [ 762.350637] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86c0c3f8-cd60-4f4c-b69c-1c66eff8121e with Priority: HIGHEST for action port [ 762.351129] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-88540781-e606-4e3c-87fb-e6581cf39d0d taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.351353] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-88540781-e606-4e3c-87fb-e6581cf39d0d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.351467] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-88540781-e606-4e3c-87fb-e6581cf39d0d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.351783] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-88540781-e606-4e3c-87fb-e6581cf39d0d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.351920] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('88540781-e606-4e3c-87fb-e6581cf39d0d',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.355374] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-88540781-e606-4e3c-87fb-e6581cf39d0d taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.355374] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88540781-e606-4e3c-87fb-e6581cf39d0d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.355374] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88540781-e606-4e3c-87fb-e6581cf39d0d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.355374] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88540781-e606-4e3c-87fb-e6581cf39d0d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.355374] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.355374] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.355374] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.355374] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.355374] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.355374] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('88540781-e606-4e3c-87fb-e6581cf39d0d',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.357657] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-86c0c3f8-cd60-4f4c-b69c-1c66eff8121e taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.357657] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-86c0c3f8-cd60-4f4c-b69c-1c66eff8121e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.357657] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-86c0c3f8-cd60-4f4c-b69c-1c66eff8121e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.357824] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-86c0c3f8-cd60-4f4c-b69c-1c66eff8121e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.357888] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('86c0c3f8-cd60-4f4c-b69c-1c66eff8121e',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.590315] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-94a13e53-dcf7-4643-ade4-8789dc9eabc4 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.590535] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.590535] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.590741] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.590917] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.591041] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.591107] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.591254] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.591343] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.591431] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.591575] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-94a13e53-dcf7-4643-ade4-8789dc9eabc4 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.591666] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.591723] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.591857] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.592014] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.592109] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.592488] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.592643] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.592724] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.592803] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.592979] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('94a13e53-dcf7-4643-ade4-8789dc9eabc4',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.859816] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-88540781-e606-4e3c-87fb-e6581cf39d0d taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.860047] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88540781-e606-4e3c-87fb-e6581cf39d0d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.860160] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('88540781-e606-4e3c-87fb-e6581cf39d0d',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.861233] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 86c0c3f8-cd60-4f4c-b69c-1c66eff8121e with status ACTIVE [ 762.861293] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.861360] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.861449] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.861638] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.861725] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.861890] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.861985] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.862066] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.862218] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.862299] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.862478] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.862563] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.862628] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.862759] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.862835] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.862913] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 86c0c3f8-cd60-4f4c-b69c-1c66eff8121e is going to be updated. [ 762.887251] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.887413] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.887413] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.887590] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.887721] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.887899] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-86c0c3f8-cd60-4f4c-b69c-1c66eff8121e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.099062] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 94a13e53-dcf7-4643-ade4-8789dc9eabc4: rpc.has_security_group_logging(os_id): False [ 763.116882] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.117981] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.118259] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.118672] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.118796] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.119120] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.119258] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.119341] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.119531] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.119635] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.119878] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.119995] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.120126] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.120266] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.120359] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.120614] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.120740] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.120790] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.120919] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.121432] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.121432] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 94a13e53-dcf7-4643-ade4-8789dc9eabc4 is going to be created. [ 763.205350] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.205350] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.205350] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.205350] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.205350] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.218040] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 94a13e53-dcf7-4643-ade4-8789dc9eabc4 in Status: IN_PROGRESS for 2s [ 763.254653] env[65337]: INFO networking_nsxv3.common.synchronization [None req-bf371791-a756-4c51-baaf-7ce939823285 None None] Enqueued Resource ID: dda95a1d-980c-4d23-a1af-1fbd5fecc1a3 with Priority: HIGHEST for action port [ 763.254653] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dda95a1d-980c-4d23-a1af-1fbd5fecc1a3 with Priority: HIGHEST for action port [ 763.254653] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-dda95a1d-980c-4d23-a1af-1fbd5fecc1a3 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.254653] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dda95a1d-980c-4d23-a1af-1fbd5fecc1a3" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.254653] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dda95a1d-980c-4d23-a1af-1fbd5fecc1a3" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.255169] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dda95a1d-980c-4d23-a1af-1fbd5fecc1a3" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.255389] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dda95a1d-980c-4d23-a1af-1fbd5fecc1a3',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.366117] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('88540781-e606-4e3c-87fb-e6581cf39d0d',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.762029] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dda95a1d-980c-4d23-a1af-1fbd5fecc1a3 [ 763.762029] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.762029] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.762029] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.762029] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.762029] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.762029] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dda95a1d-980c-4d23-a1af-1fbd5fecc1a3 already deleted. [ 763.762029] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dda95a1d-980c-4d23-a1af-1fbd5fecc1a3" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.776817] env[65337]: INFO networking_nsxv3.common.synchronization [req-6451ad17-382e-4844-9c57-5e740b57eeaf req-2ec5d688-0e55-41a4-ac48-b71be232fe18 tempest-ServersAdminTestJSON-283641549 tempest-ServersAdminTestJSON-283641549-project-member] Enqueued Resource ID: 9e889ce7-965a-4de0-b096-60d4e743cf8b with Priority: HIGHEST for action security_group_members [ 763.777362] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e889ce7-965a-4de0-b096-60d4e743cf8b with Priority: HIGHEST for action security_group_members [ 763.777668] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e889ce7-965a-4de0-b096-60d4e743cf8b taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.777789] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.777870] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.778056] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.778217] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.778311] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.778367] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.778516] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.782026] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.782026] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e889ce7-965a-4de0-b096-60d4e743cf8b',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.872273] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.872273] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.872273] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.872273] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.872273] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.872273] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88540781-e606-4e3c-87fb-e6581cf39d0d is going to be created. [ 763.892670] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.892806] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.892883] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.893265] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.893265] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.906435] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88540781-e606-4e3c-87fb-e6581cf39d0d in Status: UNINITIALIZED for 2s [ 764.111678] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock network-366 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.111961] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "network-366" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.112020] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "network-366" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.112261] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "network-366" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.112507] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.112653] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.112765] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.112964] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.113113] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.113306] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 764.113412] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 764.113513] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 764.113656] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 764.113740] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 764.113802] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 764.113923] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 764.134411] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 764.134613] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 764.134754] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 764.134919] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "network-366" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.135261] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock port-e83d1a58-6b35-4824-8a3c-e2c183bab279 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.135426] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "port-e83d1a58-6b35-4824-8a3c-e2c183bab279" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.135538] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "port-e83d1a58-6b35-4824-8a3c-e2c183bab279" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.136049] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "port-e83d1a58-6b35-4824-8a3c-e2c183bab279" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.136049] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e83d1a58-6b35-4824-8a3c-e2c183bab279',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.280294] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9e889ce7-965a-4de0-b096-60d4e743cf8b',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.638914] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.639179] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.639287] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.639572] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.639723] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.639890] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Segment Port e83d1a58-6b35-4824-8a3c-e2c183bab279 not found, creating... [ 764.640188] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.640354] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.640500] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.640696] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.640829] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.641167] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.641320] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.641432] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.641686] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.641896] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.641971] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Resource: SegmentPort with ID: e83d1a58-6b35-4824-8a3c-e2c183bab279 is going to be created. [ 764.670935] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.671162] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.671280] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.671547] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.671803] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.672036] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "port-e83d1a58-6b35-4824-8a3c-e2c183bab279" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.782681] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9e889ce7-965a-4de0-b096-60d4e743cf8b',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.245457] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 94a13e53-dcf7-4643-ade4-8789dc9eabc4 in Status: SUCCESS [ 765.245819] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.285724] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.285958] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.286052] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.286380] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.286791] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.286894] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e889ce7-965a-4de0-b096-60d4e743cf8b is going to be updated. [ 765.351554] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.352121] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.352371] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.352696] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.353015] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.365257] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e889ce7-965a-4de0-b096-60d4e743cf8b in Status: IN_PROGRESS for 2s [ 765.504261] env[65337]: INFO networking_nsxv3.common.synchronization [req-6451ad17-382e-4844-9c57-5e740b57eeaf req-da0ed9af-2d37-456e-aa6f-fd53b5213702 service nova] Enqueued Resource ID: 9e889ce7-965a-4de0-b096-60d4e743cf8b with Priority: HIGHEST for action security_group_rules [ 765.504456] env[65337]: INFO networking_nsxv3.common.synchronization [req-6451ad17-382e-4844-9c57-5e740b57eeaf req-da0ed9af-2d37-456e-aa6f-fd53b5213702 service nova] Enqueued Resource ID: 9e889ce7-965a-4de0-b096-60d4e743cf8b with Priority: HIGHEST for action security_group_members [ 765.504590] env[65337]: INFO networking_nsxv3.common.synchronization [req-6451ad17-382e-4844-9c57-5e740b57eeaf req-da0ed9af-2d37-456e-aa6f-fd53b5213702 service nova] Enqueued Resource ID: e83d1a58-6b35-4824-8a3c-e2c183bab279 with Priority: HIGHEST for action port [ 765.505119] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e889ce7-965a-4de0-b096-60d4e743cf8b with Priority: HIGHEST for action security_group_rules [ 765.505294] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e889ce7-965a-4de0-b096-60d4e743cf8b with Priority: HIGHEST for action security_group_members [ 765.505411] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e83d1a58-6b35-4824-8a3c-e2c183bab279 with Priority: HIGHEST for action port [ 765.505745] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9e889ce7-965a-4de0-b096-60d4e743cf8b taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.505800] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.505870] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.506262] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.506388] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9e889ce7-965a-4de0-b096-60d4e743cf8b',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.507319] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e889ce7-965a-4de0-b096-60d4e743cf8b taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.507442] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.508229] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-e83d1a58-6b35-4824-8a3c-e2c183bab279 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.508348] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e83d1a58-6b35-4824-8a3c-e2c183bab279" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.508417] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e83d1a58-6b35-4824-8a3c-e2c183bab279" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.508601] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e83d1a58-6b35-4824-8a3c-e2c183bab279" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.508678] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e83d1a58-6b35-4824-8a3c-e2c183bab279',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.915887] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88540781-e606-4e3c-87fb-e6581cf39d0d in Status: SUCCESS [ 765.917127] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88540781-e606-4e3c-87fb-e6581cf39d0d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.917127] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88540781-e606-4e3c-87fb-e6581cf39d0d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.917127] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88540781-e606-4e3c-87fb-e6581cf39d0d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.917127] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.917396] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.917396] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.917473] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.917509] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.918351] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88540781-e606-4e3c-87fb-e6581cf39d0d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.918351] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('88540781-e606-4e3c-87fb-e6581cf39d0d',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.011222] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e83d1a58-6b35-4824-8a3c-e2c183bab279 with status ACTIVE [ 766.011458] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.011591] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.011658] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.011939] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.011988] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.012179] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.012326] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.012417] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.012585] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.012712] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.012907] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.013047] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.013113] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.013265] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.013347] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.013430] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e83d1a58-6b35-4824-8a3c-e2c183bab279 is going to be updated. [ 766.014731] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e889ce7-965a-4de0-b096-60d4e743cf8b taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.014827] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.037199] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.037403] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.037539] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.037620] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.037753] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.037911] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e83d1a58-6b35-4824-8a3c-e2c183bab279" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.420564] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-88540781-e606-4e3c-87fb-e6581cf39d0d taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.420938] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88540781-e606-4e3c-87fb-e6581cf39d0d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.420938] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88540781-e606-4e3c-87fb-e6581cf39d0d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.421203] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88540781-e606-4e3c-87fb-e6581cf39d0d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.421378] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.421477] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.421534] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.421690] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.421784] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.421878] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88540781-e606-4e3c-87fb-e6581cf39d0d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.422039] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-88540781-e606-4e3c-87fb-e6581cf39d0d taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.423063] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88540781-e606-4e3c-87fb-e6581cf39d0d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.423063] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88540781-e606-4e3c-87fb-e6581cf39d0d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.423063] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88540781-e606-4e3c-87fb-e6581cf39d0d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.423063] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.423063] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.423063] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.423063] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.423063] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.423063] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88540781-e606-4e3c-87fb-e6581cf39d0d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.423063] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('88540781-e606-4e3c-87fb-e6581cf39d0d',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.556108] env[65337]: INFO networking_nsxv3.common.synchronization [req-8feedff5-f58d-4110-bb83-b6bf3540971a req-60b7fef1-f3c2-447e-a93d-10a10b038949 tempest-ImagesOneServerTestJSON-752365409 tempest-ImagesOneServerTestJSON-752365409-project-member] Enqueued Resource ID: b2d083bb-47e2-4637-be9f-9dbd7dc68026 with Priority: HIGHEST for action security_group_members [ 766.556684] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2d083bb-47e2-4637-be9f-9dbd7dc68026 with Priority: HIGHEST for action security_group_members [ 766.556994] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-b2d083bb-47e2-4637-be9f-9dbd7dc68026 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.557263] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b2d083bb-47e2-4637-be9f-9dbd7dc68026" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.557336] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b2d083bb-47e2-4637-be9f-9dbd7dc68026" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.557586] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b2d083bb-47e2-4637-be9f-9dbd7dc68026" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.557682] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.557783] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.557846] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.557990] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.558094] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.558187] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b2d083bb-47e2-4637-be9f-9dbd7dc68026',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.926944] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 88540781-e606-4e3c-87fb-e6581cf39d0d: rpc.has_security_group_logging(os_id): False [ 766.945904] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.946144] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.946284] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.946625] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.946709] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.946996] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.947140] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.947254] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.948172] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.948172] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.948172] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.948172] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.948172] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.948540] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.948540] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.948796] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.948949] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.949066] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.949284] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.949409] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.949549] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 88540781-e606-4e3c-87fb-e6581cf39d0d is going to be created. [ 767.023179] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.023403] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.023403] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.023612] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.023797] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.047159] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 88540781-e606-4e3c-87fb-e6581cf39d0d in Status: IN_PROGRESS for 2s [ 767.060781] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.060913] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.060993] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.061224] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.061317] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.061759] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.061759] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.061759] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.061955] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.061955] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.062043] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b2d083bb-47e2-4637-be9f-9dbd7dc68026 is going to be updated. [ 767.238024] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.238209] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.238249] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.238463] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.238606] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.248396] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b2d083bb-47e2-4637-be9f-9dbd7dc68026 in Status: IN_PROGRESS for 2s [ 767.376658] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e889ce7-965a-4de0-b096-60d4e743cf8b in Status: SUCCESS [ 767.376870] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.377057] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.377270] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.377455] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.377573] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.377638] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.377786] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.377868] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.377964] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e889ce7-965a-4de0-b096-60d4e743cf8b',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.879967] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9e889ce7-965a-4de0-b096-60d4e743cf8b',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.382748] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9e889ce7-965a-4de0-b096-60d4e743cf8b',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.622354] env[65337]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-f81d39ac-7b08-4c21-a1c2-6484bc6252df None None] NSXv3 Agent Agent loop - iteration:0 completed [ 768.622520] env[65337]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-f81d39ac-7b08-4c21-a1c2-6484bc6252df None None] NSXv3 Agent Agent loop - iteration:1 started [ 768.885982] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.886344] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.886344] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.886468] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.886573] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.886673] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e889ce7-965a-4de0-b096-60d4e743cf8b is going to be updated. [ 768.918423] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.918635] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.918635] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.918836] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.919139] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.931218] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e889ce7-965a-4de0-b096-60d4e743cf8b in Status: IN_PROGRESS for 2s [ 769.059565] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 88540781-e606-4e3c-87fb-e6581cf39d0d in Status: SUCCESS [ 769.059798] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-88540781-e606-4e3c-87fb-e6581cf39d0d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.263583] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b2d083bb-47e2-4637-be9f-9dbd7dc68026 in Status: SUCCESS [ 769.263757] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b2d083bb-47e2-4637-be9f-9dbd7dc68026 deletion is rescheduled due to dependency. [ 769.264636] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b2d083bb-47e2-4637-be9f-9dbd7dc68026" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.946283] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e889ce7-965a-4de0-b096-60d4e743cf8b in Status: SUCCESS [ 770.946663] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.946860] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.947095] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.947296] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.947637] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.947637] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.947831] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.947882] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.947986] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.948167] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9e889ce7-965a-4de0-b096-60d4e743cf8b',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.451601] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e889ce7-965a-4de0-b096-60d4e743cf8b taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.451772] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.451882] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.452368] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.452640] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.452640] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.452640] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.453060] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.453060] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.453060] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.453527] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e889ce7-965a-4de0-b096-60d4e743cf8b taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.453527] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.453658] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.453919] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.453919] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.454166] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.454166] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.454404] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.454517] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.454609] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.454692] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9e889ce7-965a-4de0-b096-60d4e743cf8b',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.557486] env[65337]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 771.557486] env[65337]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 771.960268] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9e889ce7-965a-4de0-b096-60d4e743cf8b: rpc.has_security_group_logging(os_id): False [ 771.989025] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.989025] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.989025] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.989025] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.989025] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.989025] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.989025] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.989025] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.989025] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.989025] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.989025] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.989025] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.989025] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.989025] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.989025] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.989771] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.989771] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.989771] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.989771] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.989771] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.989771] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9e889ce7-965a-4de0-b096-60d4e743cf8b is going to be updated. [ 772.071024] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.071024] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.071024] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.071024] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.071024] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.083644] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9e889ce7-965a-4de0-b096-60d4e743cf8b in Status: IN_PROGRESS for 2s [ 772.747916] env[65337]: INFO networking_nsxv3.common.synchronization [req-25ff9a2b-b2c8-49e4-977d-14b3171d242f req-9f015108-73e7-4a7b-a05c-95692e29e5a5 tempest-ImagesTestJSON-1531636912 tempest-ImagesTestJSON-1531636912-project-member] Enqueued Resource ID: 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 with Priority: HIGHEST for action security_group_members [ 772.748852] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 with Priority: HIGHEST for action security_group_members [ 772.749110] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.749110] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.749211] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.749703] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.749703] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.749703] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.749703] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.749959] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.749959] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.749959] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7db87dc2-69af-45f1-90c2-f8a4ec96c3b7',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.132283] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock network-626 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.132607] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "network-626" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.132607] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "network-626" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.132861] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "network-626" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.133354] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.133527] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.133642] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.133873] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.134073] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.134308] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 773.134372] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 773.134496] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 773.134606] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 773.134714] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 773.134814] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 773.134948] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 773.165954] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 773.165954] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 773.165954] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 773.165954] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "network-626" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.166283] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock port-de2105cf-3d9f-4620-ac04-c9ac389085d9 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.166620] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "port-de2105cf-3d9f-4620-ac04-c9ac389085d9" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.166749] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "port-de2105cf-3d9f-4620-ac04-c9ac389085d9" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.167140] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "port-de2105cf-3d9f-4620-ac04-c9ac389085d9" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.167275] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('de2105cf-3d9f-4620-ac04-c9ac389085d9',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.253595] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.256020] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.256020] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.256254] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.256337] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.256663] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.256830] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.256916] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.257303] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.257448] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.257584] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 is going to be updated. [ 773.294674] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.295050] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.295267] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.295488] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.295684] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.307246] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 in Status: IN_PROGRESS for 2s [ 773.670633] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.671401] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.671652] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.672108] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.672372] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.672595] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Segment Port de2105cf-3d9f-4620-ac04-c9ac389085d9 not found, creating... [ 773.672928] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.673910] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.674183] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.674608] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.675237] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.675806] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.676442] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.676731] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.677371] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.677663] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.678035] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Resource: SegmentPort with ID: de2105cf-3d9f-4620-ac04-c9ac389085d9 is going to be created. [ 773.703987] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.703987] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.703987] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.703987] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.703987] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.703987] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "port-de2105cf-3d9f-4620-ac04-c9ac389085d9" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.096433] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9e889ce7-965a-4de0-b096-60d4e743cf8b in Status: SUCCESS [ 774.096711] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.388095] env[65337]: INFO networking_nsxv3.common.synchronization [req-25ff9a2b-b2c8-49e4-977d-14b3171d242f req-b32c1826-1d07-4dad-8f19-838469c7405f service nova] Enqueued Resource ID: 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 with Priority: HIGHEST for action security_group_rules [ 774.388422] env[65337]: INFO networking_nsxv3.common.synchronization [req-25ff9a2b-b2c8-49e4-977d-14b3171d242f req-b32c1826-1d07-4dad-8f19-838469c7405f service nova] Enqueued Resource ID: 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 with Priority: HIGHEST for action security_group_members [ 774.388565] env[65337]: INFO networking_nsxv3.common.synchronization [req-25ff9a2b-b2c8-49e4-977d-14b3171d242f req-b32c1826-1d07-4dad-8f19-838469c7405f service nova] Enqueued Resource ID: de2105cf-3d9f-4620-ac04-c9ac389085d9 with Priority: HIGHEST for action port [ 774.389098] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 with Priority: HIGHEST for action security_group_rules [ 774.389258] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 with Priority: HIGHEST for action security_group_members [ 774.389371] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de2105cf-3d9f-4620-ac04-c9ac389085d9 with Priority: HIGHEST for action port [ 774.389667] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.389826] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.389937] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.390131] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.390208] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7db87dc2-69af-45f1-90c2-f8a4ec96c3b7',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.391581] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.391698] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.391935] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-de2105cf-3d9f-4620-ac04-c9ac389085d9 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.392043] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-de2105cf-3d9f-4620-ac04-c9ac389085d9" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.392091] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-de2105cf-3d9f-4620-ac04-c9ac389085d9" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.392319] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-de2105cf-3d9f-4620-ac04-c9ac389085d9" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.392431] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('de2105cf-3d9f-4620-ac04-c9ac389085d9',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.473612] env[65337]: INFO networking_nsxv3.common.synchronization [req-67b4ad93-2705-412b-a607-42165a3705b0 req-51b06c8a-0e65-41df-8ea5-dbb1254635d5 tempest-ServerMetadataNegativeTestJSON-900658620 tempest-ServerMetadataNegativeTestJSON-900658620-project-member] Enqueued Resource ID: b5288296-022e-4f32-a68e-bdef9f09be4e with Priority: HIGHEST for action security_group_members [ 774.474163] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5288296-022e-4f32-a68e-bdef9f09be4e with Priority: HIGHEST for action security_group_members [ 774.474731] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5288296-022e-4f32-a68e-bdef9f09be4e taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.474850] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5288296-022e-4f32-a68e-bdef9f09be4e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.474916] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5288296-022e-4f32-a68e-bdef9f09be4e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.475132] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5288296-022e-4f32-a68e-bdef9f09be4e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.475264] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.475352] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.475408] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.475835] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.475957] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.476063] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b5288296-022e-4f32-a68e-bdef9f09be4e',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.641023] env[65337]: INFO networking_nsxv3.common.synchronization [req-f2f358cf-f6ec-40d4-82a1-80f2be2eb059 req-d8208ba5-bf72-4a5e-aa80-fd080d302d5e tempest-ListImageFiltersTestJSON-525832378 tempest-ListImageFiltersTestJSON-525832378-project-member] Enqueued Resource ID: 2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24 with Priority: HIGHEST for action security_group_members [ 774.641643] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24 with Priority: HIGHEST for action security_group_members [ 774.641949] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.642740] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.642740] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.642740] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.642740] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.642740] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.642740] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.643045] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.643045] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.643114] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.895444] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.895444] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.895444] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port de2105cf-3d9f-4620-ac04-c9ac389085d9 with status ACTIVE [ 774.895444] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.895444] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.895444] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.895444] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.895444] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.895962] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.895962] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.895962] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.896195] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.897299] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.897299] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.897299] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.897299] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.897299] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.897299] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.897299] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: de2105cf-3d9f-4620-ac04-c9ac389085d9 is going to be updated. [ 774.925323] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.925771] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.925771] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.925858] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.926555] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.926555] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-de2105cf-3d9f-4620-ac04-c9ac389085d9" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.979208] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.979376] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.979450] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.979667] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.979760] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.979967] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.980094] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.980154] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.980651] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.980756] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.980838] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b5288296-022e-4f32-a68e-bdef9f09be4e is going to be updated. [ 775.024914] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.024914] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.024914] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.024914] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.024914] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.035508] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5288296-022e-4f32-a68e-bdef9f09be4e in Status: IN_PROGRESS for 2s [ 775.145851] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.321023] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 in Status: SUCCESS [ 775.321023] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 deletion is rescheduled due to dependency. [ 775.321023] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.321023] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.321023] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.321023] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.321023] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.321023] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.321023] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.321023] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.321023] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7db87dc2-69af-45f1-90c2-f8a4ec96c3b7',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.647643] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.822921] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7db87dc2-69af-45f1-90c2-f8a4ec96c3b7',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.922639] env[65337]: INFO networking_nsxv3.common.synchronization [req-f71ff3b2-a37c-4d6d-96c6-d1e5fe366c7a req-1099f5e5-7bc2-40ee-83b7-5f3559ff3538 tempest-AttachInterfacesTestJSON-1783062477 tempest-AttachInterfacesTestJSON-1783062477-project-member] Enqueued Resource ID: 94a13e53-dcf7-4643-ade4-8789dc9eabc4 with Priority: HIGHEST for action security_group_members [ 775.923360] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94a13e53-dcf7-4643-ade4-8789dc9eabc4 with Priority: HIGHEST for action security_group_members [ 775.923550] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-94a13e53-dcf7-4643-ade4-8789dc9eabc4 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.923677] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.923734] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.923940] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.927200] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.929783] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.929870] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.931165] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.931165] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.931165] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('94a13e53-dcf7-4643-ade4-8789dc9eabc4',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.153416] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.153416] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.153416] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.153416] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.153416] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.153416] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24 is going to be updated. [ 776.187877] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.187877] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.187877] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.187877] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.187877] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.196354] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24 in Status: IN_PROGRESS for 2s [ 776.325539] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7db87dc2-69af-45f1-90c2-f8a4ec96c3b7',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.436655] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.436890] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.436890] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.437196] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.437265] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.437479] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.437623] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.437675] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.437814] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.437892] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.437979] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 94a13e53-dcf7-4643-ade4-8789dc9eabc4 is going to be updated. [ 776.497370] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.497621] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.497728] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.497987] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.498689] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.510288] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94a13e53-dcf7-4643-ade4-8789dc9eabc4 in Status: IN_PROGRESS for 2s [ 776.828981] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.829423] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.829423] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.829423] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.829554] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.829586] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 is going to be updated. [ 776.866969] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.867174] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.867174] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.867342] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.867510] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.877858] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 in Status: IN_PROGRESS for 2s [ 777.048723] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5288296-022e-4f32-a68e-bdef9f09be4e in Status: SUCCESS [ 777.049299] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b5288296-022e-4f32-a68e-bdef9f09be4e deletion is rescheduled due to dependency. [ 777.049299] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5288296-022e-4f32-a68e-bdef9f09be4e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.207724] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24 in Status: SUCCESS [ 778.208617] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.523553] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94a13e53-dcf7-4643-ade4-8789dc9eabc4 in Status: SUCCESS [ 778.523846] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 94a13e53-dcf7-4643-ade4-8789dc9eabc4 deletion is rescheduled due to dependency. [ 778.523998] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.892121] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 in Status: SUCCESS [ 778.892473] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.892739] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.893094] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.893429] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.893638] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.893758] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.894069] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.894242] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.894431] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.894557] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7db87dc2-69af-45f1-90c2-f8a4ec96c3b7',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.397638] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.398209] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.398209] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.399198] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.399480] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.399677] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.399733] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.400060] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.400097] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.400226] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.400436] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.400572] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.400658] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.400857] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.401981] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.402194] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.402297] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.402492] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.402622] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.402739] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.402860] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7db87dc2-69af-45f1-90c2-f8a4ec96c3b7',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.606673] env[65337]: INFO networking_nsxv3.common.synchronization [req-6c1f367b-c510-4a87-960d-a199a5c38fa6 req-f176cb66-ec39-4403-934d-b13ee0bf0676 tempest-ServersAdminNegativeTestJSON-683436170 tempest-ServersAdminNegativeTestJSON-683436170-project-member] Enqueued Resource ID: d9afc808-3692-46b5-a84b-018d8d2b7f94 with Priority: HIGHEST for action security_group_members [ 779.607281] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9afc808-3692-46b5-a84b-018d8d2b7f94 with Priority: HIGHEST for action security_group_members [ 779.607590] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9afc808-3692-46b5-a84b-018d8d2b7f94 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.608317] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9afc808-3692-46b5-a84b-018d8d2b7f94" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.608425] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9afc808-3692-46b5-a84b-018d8d2b7f94" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.608652] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9afc808-3692-46b5-a84b-018d8d2b7f94" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.609255] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.609487] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.609587] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.609768] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.609893] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.610038] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d9afc808-3692-46b5-a84b-018d8d2b7f94',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.908931] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7: rpc.has_security_group_logging(os_id): False [ 779.933027] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.933027] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.933027] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.933027] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.933027] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.933027] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.933027] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.933027] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.933027] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.933027] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.933027] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.933027] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.933027] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.933027] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.933027] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.933859] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.933859] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.933859] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.934288] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.936019] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.936019] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 is going to be updated. [ 779.976171] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock network-292 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.976171] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "network-292" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.976171] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "network-292" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.976171] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "network-292" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.976171] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.976530] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.976773] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.978956] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.979069] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.979385] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 779.980087] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 779.980087] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 779.980087] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 779.980231] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 779.980434] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 779.980549] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 779.987022] env[65337]: INFO networking_nsxv3.common.synchronization [req-833b0cc6-466f-41bc-9435-546d8c9acf9e req-9abb55e3-92c6-45d7-8934-230ae6242f10 tempest-AttachInterfacesTestJSON-1783062477 tempest-AttachInterfacesTestJSON-1783062477-project-member] Enqueued Resource ID: ee03c436-a01f-49f3-9012-42ca1b72c1d4 with Priority: HIGHEST for action security_group_members [ 779.987022] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee03c436-a01f-49f3-9012-42ca1b72c1d4 with Priority: HIGHEST for action security_group_members [ 779.987803] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee03c436-a01f-49f3-9012-42ca1b72c1d4 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.987949] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee03c436-a01f-49f3-9012-42ca1b72c1d4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.988077] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee03c436-a01f-49f3-9012-42ca1b72c1d4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.988343] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee03c436-a01f-49f3-9012-42ca1b72c1d4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.988558] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.988689] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.988772] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.988987] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.989105] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.989231] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ee03c436-a01f-49f3-9012-42ca1b72c1d4',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.005686] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 780.005870] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 780.005986] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 780.006176] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "network-292" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.006502] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock port-ad7f2ced-48c1-4262-af3e-660561346dfe taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.006675] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "port-ad7f2ced-48c1-4262-af3e-660561346dfe" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.006798] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "port-ad7f2ced-48c1-4262-af3e-660561346dfe" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.008018] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "port-ad7f2ced-48c1-4262-af3e-660561346dfe" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.008018] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ad7f2ced-48c1-4262-af3e-660561346dfe',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.022156] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.022517] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.023145] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.023145] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.023145] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.039791] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 in Status: IN_PROGRESS for 2s [ 780.113057] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d9afc808-3692-46b5-a84b-018d8d2b7f94',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.491510] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.494964] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.494964] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.494964] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.494964] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.494964] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.494964] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.494964] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.494964] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.494964] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.494964] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee03c436-a01f-49f3-9012-42ca1b72c1d4 is going to be updated. [ 780.510843] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.512709] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.512969] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.513395] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.513699] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.513980] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Segment Port ad7f2ced-48c1-4262-af3e-660561346dfe not found, creating... [ 780.514456] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.515731] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.515731] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.515731] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.515731] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.516371] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.517545] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.517545] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.517545] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.517545] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.517871] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Resource: SegmentPort with ID: ad7f2ced-48c1-4262-af3e-660561346dfe is going to be created. [ 780.525394] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.525585] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.525671] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.525916] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.526115] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.541148] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee03c436-a01f-49f3-9012-42ca1b72c1d4 in Status: IN_PROGRESS for 2s [ 780.554522] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.554724] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.554843] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.555118] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.555337] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.555589] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "port-ad7f2ced-48c1-4262-af3e-660561346dfe" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.616170] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d9afc808-3692-46b5-a84b-018d8d2b7f94',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.118422] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.118657] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.118736] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.119034] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.119257] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.119379] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d9afc808-3692-46b5-a84b-018d8d2b7f94 is going to be updated. [ 781.150719] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.150874] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.150957] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.151345] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.151410] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.160535] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d9afc808-3692-46b5-a84b-018d8d2b7f94 in Status: IN_PROGRESS for 2s [ 781.239116] env[65337]: INFO networking_nsxv3.common.synchronization [req-6c1f367b-c510-4a87-960d-a199a5c38fa6 req-d9cd7a88-3d87-4be1-80fa-ec7bc76cc32e service nova] Enqueued Resource ID: d9afc808-3692-46b5-a84b-018d8d2b7f94 with Priority: HIGHEST for action security_group_rules [ 781.239311] env[65337]: INFO networking_nsxv3.common.synchronization [req-6c1f367b-c510-4a87-960d-a199a5c38fa6 req-d9cd7a88-3d87-4be1-80fa-ec7bc76cc32e service nova] Enqueued Resource ID: d9afc808-3692-46b5-a84b-018d8d2b7f94 with Priority: HIGHEST for action security_group_members [ 781.239441] env[65337]: INFO networking_nsxv3.common.synchronization [req-6c1f367b-c510-4a87-960d-a199a5c38fa6 req-d9cd7a88-3d87-4be1-80fa-ec7bc76cc32e service nova] Enqueued Resource ID: ad7f2ced-48c1-4262-af3e-660561346dfe with Priority: HIGHEST for action port [ 781.239966] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9afc808-3692-46b5-a84b-018d8d2b7f94 with Priority: HIGHEST for action security_group_rules [ 781.240124] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9afc808-3692-46b5-a84b-018d8d2b7f94 with Priority: HIGHEST for action security_group_members [ 781.240248] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad7f2ced-48c1-4262-af3e-660561346dfe with Priority: HIGHEST for action port [ 781.241688] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d9afc808-3692-46b5-a84b-018d8d2b7f94 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.241858] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d9afc808-3692-46b5-a84b-018d8d2b7f94" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.241928] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d9afc808-3692-46b5-a84b-018d8d2b7f94" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.242490] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d9afc808-3692-46b5-a84b-018d8d2b7f94" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.242490] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d9afc808-3692-46b5-a84b-018d8d2b7f94',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.243183] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9afc808-3692-46b5-a84b-018d8d2b7f94 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.243286] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9afc808-3692-46b5-a84b-018d8d2b7f94" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.243474] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-ad7f2ced-48c1-4262-af3e-660561346dfe taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.243573] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ad7f2ced-48c1-4262-af3e-660561346dfe" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.243635] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ad7f2ced-48c1-4262-af3e-660561346dfe" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.243808] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ad7f2ced-48c1-4262-af3e-660561346dfe" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.243906] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ad7f2ced-48c1-4262-af3e-660561346dfe',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.746093] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9afc808-3692-46b5-a84b-018d8d2b7f94 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.746452] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9afc808-3692-46b5-a84b-018d8d2b7f94" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.746452] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ad7f2ced-48c1-4262-af3e-660561346dfe with status ACTIVE [ 781.746604] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.747197] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.747197] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.747197] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.747197] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.747379] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.747379] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.747460] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.747566] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.747635] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.747807] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.747897] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.747946] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.748097] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.749191] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.749191] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ad7f2ced-48c1-4262-af3e-660561346dfe is going to be updated. [ 781.770904] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.771073] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.771144] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.771840] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.771840] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.771840] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ad7f2ced-48c1-4262-af3e-660561346dfe" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.056999] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 in Status: SUCCESS [ 782.056999] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.470559] env[65337]: INFO networking_nsxv3.common.synchronization [req-04b20920-314b-4cba-9483-0fea1edf0fdb req-e05c5563-f878-437b-b832-41d38db53511 tempest-ServerDiskConfigTestJSON-1745593668 tempest-ServerDiskConfigTestJSON-1745593668-project-member] Enqueued Resource ID: 653446ea-2b31-43b8-a920-884274265c75 with Priority: HIGHEST for action security_group_members [ 782.471096] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 653446ea-2b31-43b8-a920-884274265c75 with Priority: HIGHEST for action security_group_members [ 782.471368] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-653446ea-2b31-43b8-a920-884274265c75 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.471488] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.471555] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.471748] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.471897] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.473586] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.473586] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.473586] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.473586] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.473586] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('653446ea-2b31-43b8-a920-884274265c75',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.555374] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee03c436-a01f-49f3-9012-42ca1b72c1d4 in Status: SUCCESS [ 782.555374] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee03c436-a01f-49f3-9012-42ca1b72c1d4 deletion is rescheduled due to dependency. [ 782.555529] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee03c436-a01f-49f3-9012-42ca1b72c1d4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.826649] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock network-73 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.826999] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "network-73" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.826999] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "network-73" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.827594] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "network-73" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.827594] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.827708] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.827762] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.827947] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.828098] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.828704] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 782.828704] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 782.828704] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 782.828942] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 782.829114] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 782.829493] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 782.829493] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 782.850120] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 782.850240] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 782.850344] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 782.850612] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "network-73" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.850984] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock port-9915a610-2dae-4120-854a-db1528cd01f9 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.851180] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "port-9915a610-2dae-4120-854a-db1528cd01f9" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.851297] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "port-9915a610-2dae-4120-854a-db1528cd01f9" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.851609] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "port-9915a610-2dae-4120-854a-db1528cd01f9" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.851745] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9915a610-2dae-4120-854a-db1528cd01f9',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.975881] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.975881] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.976079] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.976150] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.976253] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.976448] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.976549] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.976616] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.976796] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.976873] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.976959] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 653446ea-2b31-43b8-a920-884274265c75 is going to be updated. [ 783.011841] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.011995] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.012089] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.013280] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.013280] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.022122] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 653446ea-2b31-43b8-a920-884274265c75 in Status: IN_PROGRESS for 2s [ 783.172238] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d9afc808-3692-46b5-a84b-018d8d2b7f94 in Status: SUCCESS [ 783.172238] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9afc808-3692-46b5-a84b-018d8d2b7f94" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.172238] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9afc808-3692-46b5-a84b-018d8d2b7f94" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.172489] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9afc808-3692-46b5-a84b-018d8d2b7f94" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.172646] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.172723] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.172762] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.172948] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.172983] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.173097] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d9afc808-3692-46b5-a84b-018d8d2b7f94',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.354510] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.354704] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.354858] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.355103] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.355256] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.355400] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Segment Port 9915a610-2dae-4120-854a-db1528cd01f9 not found, creating... [ 783.355658] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.355809] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.355997] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.356501] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.356501] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.356673] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.356673] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.356818] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.356968] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.357104] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.357235] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Resource: SegmentPort with ID: 9915a610-2dae-4120-854a-db1528cd01f9 is going to be created. [ 783.378554] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.378821] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.378932] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.379200] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.379417] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.379638] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "port-9915a610-2dae-4120-854a-db1528cd01f9" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.675946] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d9afc808-3692-46b5-a84b-018d8d2b7f94',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.178519] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d9afc808-3692-46b5-a84b-018d8d2b7f94',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.202918] env[65337]: INFO networking_nsxv3.common.synchronization [req-04b20920-314b-4cba-9483-0fea1edf0fdb req-5df5fbc3-7515-4198-a207-2760da2ea947 service nova] Enqueued Resource ID: 653446ea-2b31-43b8-a920-884274265c75 with Priority: HIGHEST for action security_group_rules [ 784.202918] env[65337]: INFO networking_nsxv3.common.synchronization [req-04b20920-314b-4cba-9483-0fea1edf0fdb req-5df5fbc3-7515-4198-a207-2760da2ea947 service nova] Enqueued Resource ID: 653446ea-2b31-43b8-a920-884274265c75 with Priority: HIGHEST for action security_group_members [ 784.202918] env[65337]: INFO networking_nsxv3.common.synchronization [req-04b20920-314b-4cba-9483-0fea1edf0fdb req-5df5fbc3-7515-4198-a207-2760da2ea947 service nova] Enqueued Resource ID: 9915a610-2dae-4120-854a-db1528cd01f9 with Priority: HIGHEST for action port [ 784.203757] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 653446ea-2b31-43b8-a920-884274265c75 with Priority: HIGHEST for action security_group_rules [ 784.203914] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 653446ea-2b31-43b8-a920-884274265c75 with Priority: HIGHEST for action security_group_members [ 784.203948] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9915a610-2dae-4120-854a-db1528cd01f9 with Priority: HIGHEST for action port [ 784.204474] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-653446ea-2b31-43b8-a920-884274265c75 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.204619] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.204619] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.204853] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.204927] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('653446ea-2b31-43b8-a920-884274265c75',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.205864] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-653446ea-2b31-43b8-a920-884274265c75 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.205974] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.206230] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-9915a610-2dae-4120-854a-db1528cd01f9 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.206348] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9915a610-2dae-4120-854a-db1528cd01f9" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.206407] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9915a610-2dae-4120-854a-db1528cd01f9" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.206653] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9915a610-2dae-4120-854a-db1528cd01f9" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.206706] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9915a610-2dae-4120-854a-db1528cd01f9',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.683111] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.683275] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.683341] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.683548] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.683632] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.683728] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d9afc808-3692-46b5-a84b-018d8d2b7f94 is going to be updated. [ 784.708905] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-653446ea-2b31-43b8-a920-884274265c75 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.709181] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.709368] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9915a610-2dae-4120-854a-db1528cd01f9 with status ACTIVE [ 784.709600] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.709750] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.709825] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.710071] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.710168] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.710337] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.710437] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.710526] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.710733] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.710852] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.711058] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.711160] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.711226] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.711384] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.711497] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.711577] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9915a610-2dae-4120-854a-db1528cd01f9 is going to be updated. [ 784.717877] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.718046] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.718136] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.718407] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.718567] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.729442] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d9afc808-3692-46b5-a84b-018d8d2b7f94 in Status: IN_PROGRESS for 2s [ 784.741828] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.742281] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.742281] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.742462] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.742610] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.742811] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9915a610-2dae-4120-854a-db1528cd01f9" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.032631] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 653446ea-2b31-43b8-a920-884274265c75 in Status: SUCCESS [ 785.033112] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 653446ea-2b31-43b8-a920-884274265c75 deletion is rescheduled due to dependency. [ 785.033403] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.033701] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.034562] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.034562] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.034562] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.034562] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.034562] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.034756] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.035578] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('653446ea-2b31-43b8-a920-884274265c75',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.396409] env[65337]: INFO networking_nsxv3.common.synchronization [req-8d3ed772-0206-4b69-bca0-5a5cdf551c48 req-d6a30605-8153-480b-9547-b6a77b258c7b tempest-FloatingIPsAssociationNegativeTestJSON-108411543 tempest-FloatingIPsAssociationNegativeTestJSON-108411543-project-member] Enqueued Resource ID: 88540781-e606-4e3c-87fb-e6581cf39d0d with Priority: HIGHEST for action security_group_members [ 785.396981] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88540781-e606-4e3c-87fb-e6581cf39d0d with Priority: HIGHEST for action security_group_members [ 785.397300] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-88540781-e606-4e3c-87fb-e6581cf39d0d taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.400681] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88540781-e606-4e3c-87fb-e6581cf39d0d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.400829] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88540781-e606-4e3c-87fb-e6581cf39d0d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.401325] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88540781-e606-4e3c-87fb-e6581cf39d0d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.402060] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.402223] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.402321] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.403367] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.403490] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.403610] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('88540781-e606-4e3c-87fb-e6581cf39d0d',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.538065] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('653446ea-2b31-43b8-a920-884274265c75',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.906241] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.906494] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.906494] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.909303] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.909459] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.909725] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.909844] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.909914] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.910241] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.910241] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.910408] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88540781-e606-4e3c-87fb-e6581cf39d0d is going to be updated. [ 785.944615] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.944803] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.944803] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.944989] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.945156] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.958399] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88540781-e606-4e3c-87fb-e6581cf39d0d in Status: IN_PROGRESS for 2s [ 786.038992] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('653446ea-2b31-43b8-a920-884274265c75',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.541607] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.544398] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.544398] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.544398] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.544398] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.544398] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 653446ea-2b31-43b8-a920-884274265c75 is going to be updated. [ 786.581459] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.581871] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.582018] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.582231] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.583462] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.594536] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 653446ea-2b31-43b8-a920-884274265c75 in Status: IN_PROGRESS for 2s [ 786.739728] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d9afc808-3692-46b5-a84b-018d8d2b7f94 in Status: SUCCESS [ 786.739965] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9afc808-3692-46b5-a84b-018d8d2b7f94" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.741790] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9afc808-3692-46b5-a84b-018d8d2b7f94" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.741790] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9afc808-3692-46b5-a84b-018d8d2b7f94" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.741790] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.741790] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.741790] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.741790] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.741790] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.741790] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9afc808-3692-46b5-a84b-018d8d2b7f94" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.741790] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d9afc808-3692-46b5-a84b-018d8d2b7f94',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.243345] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9afc808-3692-46b5-a84b-018d8d2b7f94 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.244125] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9afc808-3692-46b5-a84b-018d8d2b7f94" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.244125] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9afc808-3692-46b5-a84b-018d8d2b7f94" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.245083] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9afc808-3692-46b5-a84b-018d8d2b7f94" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.245083] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.245214] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.245214] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.245343] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.245491] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.245640] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9afc808-3692-46b5-a84b-018d8d2b7f94" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.245829] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9afc808-3692-46b5-a84b-018d8d2b7f94 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.245914] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9afc808-3692-46b5-a84b-018d8d2b7f94" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.245977] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9afc808-3692-46b5-a84b-018d8d2b7f94" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.246750] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9afc808-3692-46b5-a84b-018d8d2b7f94" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.246922] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.247079] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.247129] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.247240] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.247321] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.247407] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9afc808-3692-46b5-a84b-018d8d2b7f94" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.247499] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d9afc808-3692-46b5-a84b-018d8d2b7f94',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.588026] env[65337]: INFO networking_nsxv3.common.synchronization [req-17bbf0a3-5b61-4e35-b04f-ad67c1bb62a4 req-27906ac9-2be1-4738-b105-dc4380604abf tempest-ServerRescueTestJSON-1216775078 tempest-ServerRescueTestJSON-1216775078-project-member] Enqueued Resource ID: 85232c6c-cd42-4a15-9924-943a4e75a091 with Priority: HIGHEST for action security_group_members [ 787.588675] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85232c6c-cd42-4a15-9924-943a4e75a091 with Priority: HIGHEST for action security_group_members [ 787.588996] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-85232c6c-cd42-4a15-9924-943a4e75a091 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.589134] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85232c6c-cd42-4a15-9924-943a4e75a091" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.589217] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85232c6c-cd42-4a15-9924-943a4e75a091" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.589480] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85232c6c-cd42-4a15-9924-943a4e75a091" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.589772] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.589772] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.589772] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.590059] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.590059] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.590174] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('85232c6c-cd42-4a15-9924-943a4e75a091',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.755596] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d9afc808-3692-46b5-a84b-018d8d2b7f94: rpc.has_security_group_logging(os_id): False [ 787.776241] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.776241] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.776241] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.776241] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.776241] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.776465] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.776521] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.776581] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.777063] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.777063] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.777063] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.777063] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.777258] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.777324] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.777445] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.777698] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.777785] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.777826] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.782645] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.782645] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.782645] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d9afc808-3692-46b5-a84b-018d8d2b7f94 is going to be updated. [ 787.852272] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.852451] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.852518] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.852748] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.853632] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.869464] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d9afc808-3692-46b5-a84b-018d8d2b7f94 in Status: IN_PROGRESS for 2s [ 787.970921] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88540781-e606-4e3c-87fb-e6581cf39d0d in Status: SUCCESS [ 787.971129] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88540781-e606-4e3c-87fb-e6581cf39d0d deletion is rescheduled due to dependency. [ 787.971258] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88540781-e606-4e3c-87fb-e6581cf39d0d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.071114] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock network-775 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.071378] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "network-775" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.071544] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "network-775" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.071848] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "network-775" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.072385] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.072555] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.072683] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.072960] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.073120] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.073345] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 788.073453] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 788.073554] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 788.073653] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 788.073755] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 788.073872] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 788.074012] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 788.092131] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('85232c6c-cd42-4a15-9924-943a4e75a091',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.099717] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 788.099942] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 788.100149] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 788.100397] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "network-775" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.100851] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock port-05d6412f-fbb8-47ce-8ce2-1fcadab0dce7 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.101086] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "port-05d6412f-fbb8-47ce-8ce2-1fcadab0dce7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.101254] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "port-05d6412f-fbb8-47ce-8ce2-1fcadab0dce7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.101754] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "port-05d6412f-fbb8-47ce-8ce2-1fcadab0dce7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.101888] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('05d6412f-fbb8-47ce-8ce2-1fcadab0dce7',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.595017] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('85232c6c-cd42-4a15-9924-943a4e75a091',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.604885] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.605133] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.605308] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.605644] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.605802] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.605962] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Segment Port 05d6412f-fbb8-47ce-8ce2-1fcadab0dce7 not found, creating... [ 788.610500] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.610727] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.610909] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.611306] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.611495] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.614187] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.614187] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.614187] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.614187] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.614187] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.614187] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Resource: SegmentPort with ID: 05d6412f-fbb8-47ce-8ce2-1fcadab0dce7 is going to be created. [ 788.618995] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 653446ea-2b31-43b8-a920-884274265c75 in Status: SUCCESS [ 788.619319] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.619955] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.620223] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.620416] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.620582] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.620648] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.620802] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.620884] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.620966] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.621069] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('653446ea-2b31-43b8-a920-884274265c75',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.650340] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.650340] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.650570] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.651199] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.652159] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.652159] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "port-05d6412f-fbb8-47ce-8ce2-1fcadab0dce7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.099037] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.099037] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.099037] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.099316] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.099316] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.099316] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85232c6c-cd42-4a15-9924-943a4e75a091 is going to be updated. [ 789.129172] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-653446ea-2b31-43b8-a920-884274265c75 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.129172] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.129172] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.129172] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.129172] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.129172] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.129172] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.129172] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.129172] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.129172] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.129172] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-653446ea-2b31-43b8-a920-884274265c75 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.129172] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.129172] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.129172] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.129172] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.129714] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.129714] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.129714] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.129714] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.129824] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.131046] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('653446ea-2b31-43b8-a920-884274265c75',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.137356] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.137356] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.137356] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.137356] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.137356] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.148425] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85232c6c-cd42-4a15-9924-943a4e75a091 in Status: IN_PROGRESS for 2s [ 789.419077] env[65337]: INFO networking_nsxv3.common.synchronization [req-17bbf0a3-5b61-4e35-b04f-ad67c1bb62a4 req-7ea773f9-b679-4b22-89d0-f3ab5cc3a491 service nova] Enqueued Resource ID: 85232c6c-cd42-4a15-9924-943a4e75a091 with Priority: HIGHEST for action security_group_rules [ 789.419341] env[65337]: INFO networking_nsxv3.common.synchronization [req-17bbf0a3-5b61-4e35-b04f-ad67c1bb62a4 req-7ea773f9-b679-4b22-89d0-f3ab5cc3a491 service nova] Enqueued Resource ID: 85232c6c-cd42-4a15-9924-943a4e75a091 with Priority: HIGHEST for action security_group_members [ 789.419549] env[65337]: INFO networking_nsxv3.common.synchronization [req-17bbf0a3-5b61-4e35-b04f-ad67c1bb62a4 req-7ea773f9-b679-4b22-89d0-f3ab5cc3a491 service nova] Enqueued Resource ID: 05d6412f-fbb8-47ce-8ce2-1fcadab0dce7 with Priority: HIGHEST for action port [ 789.420251] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85232c6c-cd42-4a15-9924-943a4e75a091 with Priority: HIGHEST for action security_group_rules [ 789.420431] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85232c6c-cd42-4a15-9924-943a4e75a091 with Priority: HIGHEST for action security_group_members [ 789.420505] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05d6412f-fbb8-47ce-8ce2-1fcadab0dce7 with Priority: HIGHEST for action port [ 789.421790] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-85232c6c-cd42-4a15-9924-943a4e75a091 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.421790] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-85232c6c-cd42-4a15-9924-943a4e75a091" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.421790] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-85232c6c-cd42-4a15-9924-943a4e75a091" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.421790] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-85232c6c-cd42-4a15-9924-943a4e75a091" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.421790] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('85232c6c-cd42-4a15-9924-943a4e75a091',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.422353] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-85232c6c-cd42-4a15-9924-943a4e75a091 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.422640] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85232c6c-cd42-4a15-9924-943a4e75a091" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.422640] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-05d6412f-fbb8-47ce-8ce2-1fcadab0dce7 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.422738] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-05d6412f-fbb8-47ce-8ce2-1fcadab0dce7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.422738] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-05d6412f-fbb8-47ce-8ce2-1fcadab0dce7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.423156] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-05d6412f-fbb8-47ce-8ce2-1fcadab0dce7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.423156] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('05d6412f-fbb8-47ce-8ce2-1fcadab0dce7',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.633074] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 653446ea-2b31-43b8-a920-884274265c75: rpc.has_security_group_logging(os_id): False [ 789.657220] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.657374] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.657446] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.657667] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.658148] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.658148] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.658148] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.658148] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.658339] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.658339] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.658543] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.658656] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.658656] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.658886] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.658964] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.659127] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.659363] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.659363] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.659488] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.659488] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.659573] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 653446ea-2b31-43b8-a920-884274265c75 is going to be updated. [ 789.752348] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.752516] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.752586] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.754660] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.754660] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.769082] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 653446ea-2b31-43b8-a920-884274265c75 in Status: IN_PROGRESS for 2s [ 789.882771] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d9afc808-3692-46b5-a84b-018d8d2b7f94 in Status: SUCCESS [ 789.883046] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d9afc808-3692-46b5-a84b-018d8d2b7f94" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.927947] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-85232c6c-cd42-4a15-9924-943a4e75a091 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.928193] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85232c6c-cd42-4a15-9924-943a4e75a091" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.928331] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 05d6412f-fbb8-47ce-8ce2-1fcadab0dce7 with status ACTIVE [ 789.928510] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.928637] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.928708] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.928929] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.929032] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.929220] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.929322] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.929374] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.929573] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.929722] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.929920] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.930031] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.930098] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.930231] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.930303] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.930387] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 05d6412f-fbb8-47ce-8ce2-1fcadab0dce7 is going to be updated. [ 789.953209] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.953405] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.953446] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.953634] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.953879] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.954118] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-05d6412f-fbb8-47ce-8ce2-1fcadab0dce7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.997300] env[65337]: INFO networking_nsxv3.common.synchronization [None req-c8e3be6b-52a2-41bd-8ed9-dbdbf5810a64 None None] Enqueued Resource ID: 8ed7e53f-c97d-4111-9689-20aeb6c4e4cd with Priority: HIGHEST for action port [ 790.998360] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ed7e53f-c97d-4111-9689-20aeb6c4e4cd with Priority: HIGHEST for action port [ 790.999092] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-8ed7e53f-c97d-4111-9689-20aeb6c4e4cd taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.002078] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8ed7e53f-c97d-4111-9689-20aeb6c4e4cd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.002078] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8ed7e53f-c97d-4111-9689-20aeb6c4e4cd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.002078] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8ed7e53f-c97d-4111-9689-20aeb6c4e4cd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.002078] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8ed7e53f-c97d-4111-9689-20aeb6c4e4cd',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.163456] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85232c6c-cd42-4a15-9924-943a4e75a091 in Status: SUCCESS [ 791.163734] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85232c6c-cd42-4a15-9924-943a4e75a091" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.163937] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85232c6c-cd42-4a15-9924-943a4e75a091" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.164454] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85232c6c-cd42-4a15-9924-943a4e75a091" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.164678] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.164804] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.164872] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.165095] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.165470] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.165538] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('85232c6c-cd42-4a15-9924-943a4e75a091',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.503922] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8ed7e53f-c97d-4111-9689-20aeb6c4e4cd [ 791.503922] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.503922] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.503922] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.504255] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.504326] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.504449] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8ed7e53f-c97d-4111-9689-20aeb6c4e4cd already deleted. [ 791.504555] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8ed7e53f-c97d-4111-9689-20aeb6c4e4cd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.670271] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('85232c6c-cd42-4a15-9924-943a4e75a091',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.788712] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 653446ea-2b31-43b8-a920-884274265c75 in Status: SUCCESS [ 791.789110] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.174513] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('85232c6c-cd42-4a15-9924-943a4e75a091',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.677160] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.677416] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.677477] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.677953] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.678109] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.678256] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85232c6c-cd42-4a15-9924-943a4e75a091 is going to be updated. [ 792.709630] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.709824] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.709910] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.710178] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.710344] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.726330] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85232c6c-cd42-4a15-9924-943a4e75a091 in Status: IN_PROGRESS for 2s [ 792.938609] env[65337]: INFO networking_nsxv3.common.synchronization [req-261efc0a-5206-4fb9-8672-c103df9496dc req-03c61edb-b7d9-4668-8518-bdf15bf0c7e0 tempest-ImagesOneServerNegativeTestJSON-1864647261 tempest-ImagesOneServerNegativeTestJSON-1864647261-project-member] Enqueued Resource ID: 12a747a0-2898-4059-bada-c453c5c41052 with Priority: HIGHEST for action security_group_members [ 792.939544] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12a747a0-2898-4059-bada-c453c5c41052 with Priority: HIGHEST for action security_group_members [ 792.939544] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-12a747a0-2898-4059-bada-c453c5c41052 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.939758] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12a747a0-2898-4059-bada-c453c5c41052" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.939758] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12a747a0-2898-4059-bada-c453c5c41052" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.940022] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12a747a0-2898-4059-bada-c453c5c41052" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.941314] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.941479] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.941571] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.941694] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.941811] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.941894] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('12a747a0-2898-4059-bada-c453c5c41052',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.325513] env[65337]: INFO networking_nsxv3.common.synchronization [None req-c42fd675-5ed9-4283-bda7-8ce302415e0b None None] Enqueued Resource ID: 552ddfed-1682-4e90-9237-89a1b6cd0522 with Priority: HIGHEST for action port [ 793.325513] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 552ddfed-1682-4e90-9237-89a1b6cd0522 with Priority: HIGHEST for action port [ 793.326723] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-552ddfed-1682-4e90-9237-89a1b6cd0522 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.326877] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-552ddfed-1682-4e90-9237-89a1b6cd0522" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.326877] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-552ddfed-1682-4e90-9237-89a1b6cd0522" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.327130] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-552ddfed-1682-4e90-9237-89a1b6cd0522" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.327202] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('552ddfed-1682-4e90-9237-89a1b6cd0522',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.336084] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock network-514 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.338031] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "network-514" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.338031] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "network-514" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.338031] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "network-514" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.338031] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.338031] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.338031] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.338031] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.338371] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.338515] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 793.338568] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 793.338650] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 793.338755] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 793.338856] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 793.338953] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 793.339090] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 793.361770] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 793.363556] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 793.363556] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 793.363556] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "network-514" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.364422] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock port-1211f939-d7d8-4e9f-814d-cac99989a94e taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.364422] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "port-1211f939-d7d8-4e9f-814d-cac99989a94e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.364422] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "port-1211f939-d7d8-4e9f-814d-cac99989a94e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.364711] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "port-1211f939-d7d8-4e9f-814d-cac99989a94e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.365566] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1211f939-d7d8-4e9f-814d-cac99989a94e',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.445252] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.445535] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.445679] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.445896] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.445991] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.446216] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.446322] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.446446] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.446562] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.446651] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.446994] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12a747a0-2898-4059-bada-c453c5c41052 already deleted. [ 793.446994] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12a747a0-2898-4059-bada-c453c5c41052" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.831658] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 552ddfed-1682-4e90-9237-89a1b6cd0522 [ 793.831970] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.832213] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.832213] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.836023] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.836023] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.836023] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:552ddfed-1682-4e90-9237-89a1b6cd0522 already deleted. [ 793.836023] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-552ddfed-1682-4e90-9237-89a1b6cd0522" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.868695] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.868947] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.869101] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.869425] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.869596] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.870063] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Segment Port 1211f939-d7d8-4e9f-814d-cac99989a94e not found, creating... [ 793.870063] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.870242] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.870337] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.870517] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.870709] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.870962] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.871366] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.871461] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.871766] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.871973] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.872156] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Resource: SegmentPort with ID: 1211f939-d7d8-4e9f-814d-cac99989a94e is going to be created. [ 793.893726] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.894059] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.894569] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.894883] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.895126] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.895372] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "port-1211f939-d7d8-4e9f-814d-cac99989a94e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.618010] env[65337]: INFO networking_nsxv3.common.synchronization [req-261efc0a-5206-4fb9-8672-c103df9496dc req-7cb45d16-7256-4e19-bb47-87c02b6e3cba service nova] Enqueued Resource ID: 12a747a0-2898-4059-bada-c453c5c41052 with Priority: HIGHEST for action security_group_rules [ 794.618256] env[65337]: INFO networking_nsxv3.common.synchronization [req-261efc0a-5206-4fb9-8672-c103df9496dc req-7cb45d16-7256-4e19-bb47-87c02b6e3cba service nova] Enqueued Resource ID: 12a747a0-2898-4059-bada-c453c5c41052 with Priority: HIGHEST for action security_group_members [ 794.618345] env[65337]: INFO networking_nsxv3.common.synchronization [req-261efc0a-5206-4fb9-8672-c103df9496dc req-7cb45d16-7256-4e19-bb47-87c02b6e3cba service nova] Enqueued Resource ID: 1211f939-d7d8-4e9f-814d-cac99989a94e with Priority: HIGHEST for action port [ 794.618884] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12a747a0-2898-4059-bada-c453c5c41052 with Priority: HIGHEST for action security_group_rules [ 794.620492] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12a747a0-2898-4059-bada-c453c5c41052 with Priority: HIGHEST for action security_group_members [ 794.621959] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1211f939-d7d8-4e9f-814d-cac99989a94e with Priority: HIGHEST for action port [ 794.622305] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-12a747a0-2898-4059-bada-c453c5c41052 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.622453] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-12a747a0-2898-4059-bada-c453c5c41052" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.622533] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-12a747a0-2898-4059-bada-c453c5c41052" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.622784] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-12a747a0-2898-4059-bada-c453c5c41052" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.623098] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('12a747a0-2898-4059-bada-c453c5c41052',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.624400] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-12a747a0-2898-4059-bada-c453c5c41052 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.624557] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12a747a0-2898-4059-bada-c453c5c41052" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.624557] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12a747a0-2898-4059-bada-c453c5c41052" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.624731] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12a747a0-2898-4059-bada-c453c5c41052" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.624888] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.624984] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.625056] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.625208] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.625293] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.625384] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('12a747a0-2898-4059-bada-c453c5c41052',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.626213] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-1211f939-d7d8-4e9f-814d-cac99989a94e taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.626317] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1211f939-d7d8-4e9f-814d-cac99989a94e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.626378] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1211f939-d7d8-4e9f-814d-cac99989a94e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.626529] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1211f939-d7d8-4e9f-814d-cac99989a94e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.626601] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1211f939-d7d8-4e9f-814d-cac99989a94e',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.741017] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85232c6c-cd42-4a15-9924-943a4e75a091 in Status: SUCCESS [ 794.741017] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85232c6c-cd42-4a15-9924-943a4e75a091" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.741017] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85232c6c-cd42-4a15-9924-943a4e75a091" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.741017] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85232c6c-cd42-4a15-9924-943a4e75a091" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.741017] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.741017] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.741017] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.741663] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.741663] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.742734] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85232c6c-cd42-4a15-9924-943a4e75a091" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.742734] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('85232c6c-cd42-4a15-9924-943a4e75a091',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.129394] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-12a747a0-2898-4059-bada-c453c5c41052 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.129394] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12a747a0-2898-4059-bada-c453c5c41052" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.129394] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1211f939-d7d8-4e9f-814d-cac99989a94e with status ACTIVE [ 795.129629] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.129629] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.129629] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.129798] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.129889] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.130087] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.130186] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.130274] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.130407] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.130489] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.130669] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.130789] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.130846] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.130985] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.131075] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.131161] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1211f939-d7d8-4e9f-814d-cac99989a94e is going to be updated. [ 795.132610] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('12a747a0-2898-4059-bada-c453c5c41052',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.162277] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.164975] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.164975] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.164975] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.164975] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.164975] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1211f939-d7d8-4e9f-814d-cac99989a94e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.244309] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-85232c6c-cd42-4a15-9924-943a4e75a091 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.244597] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85232c6c-cd42-4a15-9924-943a4e75a091" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.244597] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85232c6c-cd42-4a15-9924-943a4e75a091" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.244800] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85232c6c-cd42-4a15-9924-943a4e75a091" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.244971] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.245182] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.245330] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.245534] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.245643] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.245743] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85232c6c-cd42-4a15-9924-943a4e75a091" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.245909] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-85232c6c-cd42-4a15-9924-943a4e75a091 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.246031] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85232c6c-cd42-4a15-9924-943a4e75a091" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.246086] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85232c6c-cd42-4a15-9924-943a4e75a091" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.246261] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85232c6c-cd42-4a15-9924-943a4e75a091" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.246563] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.246563] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.246563] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.246797] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.246797] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.246797] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85232c6c-cd42-4a15-9924-943a4e75a091" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.246912] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('85232c6c-cd42-4a15-9924-943a4e75a091',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.635084] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('12a747a0-2898-4059-bada-c453c5c41052',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.705842] env[65337]: INFO networking_nsxv3.common.synchronization [req-8e071638-f3f9-4b5a-92aa-c332512c2f4e req-a5d899b8-e34d-475d-b9aa-cd3a5b7eba98 tempest-DeleteServersTestJSON-1654690426 tempest-DeleteServersTestJSON-1654690426-project-member] Enqueued Resource ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d with Priority: HIGHEST for action security_group_members [ 795.705842] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d with Priority: HIGHEST for action security_group_members [ 795.706060] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-161889a4-32a2-48ee-8fb7-d2a961a4b28d taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.706148] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.706209] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.706352] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.706502] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.706617] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.706710] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.706944] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.706944] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.707131] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('161889a4-32a2-48ee-8fb7-d2a961a4b28d',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.750017] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 85232c6c-cd42-4a15-9924-943a4e75a091: rpc.has_security_group_logging(os_id): False [ 795.777415] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.777415] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.777415] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.778080] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.778080] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.778266] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.778423] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.778565] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.778791] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.778909] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.779252] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.779445] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.779545] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.779753] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.779868] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.780130] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.780269] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.780417] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.780637] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.780784] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.780930] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 85232c6c-cd42-4a15-9924-943a4e75a091 is going to be updated. [ 795.855042] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.855042] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.855042] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.855042] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.855042] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.869159] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 85232c6c-cd42-4a15-9924-943a4e75a091 in Status: IN_PROGRESS for 2s [ 796.128157] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock network-211 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.128485] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "network-211" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.128651] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "network-211" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.129134] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "network-211" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.129282] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.129443] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.129578] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.129825] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.130015] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.130227] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 796.130353] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 796.130467] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 796.130618] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 796.130753] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 796.130861] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 796.130991] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 796.139581] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.139743] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.139817] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.140025] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.140119] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.140217] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12a747a0-2898-4059-bada-c453c5c41052 is going to be created. [ 796.152774] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 796.152937] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 796.153114] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 796.153259] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "network-211" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.153581] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock port-11eec8ca-06b2-411c-b25d-c862707f8ca2 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.153751] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "port-11eec8ca-06b2-411c-b25d-c862707f8ca2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.153862] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "port-11eec8ca-06b2-411c-b25d-c862707f8ca2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.154225] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "port-11eec8ca-06b2-411c-b25d-c862707f8ca2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.154516] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('11eec8ca-06b2-411c-b25d-c862707f8ca2',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.169155] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.169155] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.169155] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.169155] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.169155] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.179791] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12a747a0-2898-4059-bada-c453c5c41052 in Status: UNINITIALIZED for 2s [ 796.210874] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.211039] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.211106] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.211330] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.211422] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.211623] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.211719] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.211790] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.211921] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.211992] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.212088] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d is going to be updated. [ 796.243315] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.243457] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.244840] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.244840] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.244840] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.260152] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d in Status: IN_PROGRESS for 2s [ 796.657350] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.657708] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.657708] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.657981] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.658137] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.658283] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Segment Port 11eec8ca-06b2-411c-b25d-c862707f8ca2 not found, creating... [ 796.658532] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.658684] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.658794] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.659019] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.659149] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.659845] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.660026] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.660143] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.660348] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.660475] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.660613] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Resource: SegmentPort with ID: 11eec8ca-06b2-411c-b25d-c862707f8ca2 is going to be created. [ 796.683975] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.684209] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.684336] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.684677] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.684905] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.685138] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "port-11eec8ca-06b2-411c-b25d-c862707f8ca2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.388833] env[65337]: INFO networking_nsxv3.common.synchronization [req-8e071638-f3f9-4b5a-92aa-c332512c2f4e req-bc524098-bc07-405b-a259-00057d348e90 service nova] Enqueued Resource ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d with Priority: HIGHEST for action security_group_rules [ 797.389054] env[65337]: INFO networking_nsxv3.common.synchronization [req-8e071638-f3f9-4b5a-92aa-c332512c2f4e req-bc524098-bc07-405b-a259-00057d348e90 service nova] Enqueued Resource ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d with Priority: HIGHEST for action security_group_members [ 797.389195] env[65337]: INFO networking_nsxv3.common.synchronization [req-8e071638-f3f9-4b5a-92aa-c332512c2f4e req-bc524098-bc07-405b-a259-00057d348e90 service nova] Enqueued Resource ID: 11eec8ca-06b2-411c-b25d-c862707f8ca2 with Priority: HIGHEST for action port [ 797.389704] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d with Priority: HIGHEST for action security_group_rules [ 797.389850] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d with Priority: HIGHEST for action security_group_members [ 797.389941] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11eec8ca-06b2-411c-b25d-c862707f8ca2 with Priority: HIGHEST for action port [ 797.390282] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-161889a4-32a2-48ee-8fb7-d2a961a4b28d taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.390476] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.390476] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.390839] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.390839] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('161889a4-32a2-48ee-8fb7-d2a961a4b28d',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.391564] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-161889a4-32a2-48ee-8fb7-d2a961a4b28d taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.391800] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.392029] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-11eec8ca-06b2-411c-b25d-c862707f8ca2 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.392141] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-11eec8ca-06b2-411c-b25d-c862707f8ca2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.392318] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-11eec8ca-06b2-411c-b25d-c862707f8ca2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.392404] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-11eec8ca-06b2-411c-b25d-c862707f8ca2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.392486] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('11eec8ca-06b2-411c-b25d-c862707f8ca2',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.883721] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 85232c6c-cd42-4a15-9924-943a4e75a091 in Status: SUCCESS [ 797.884126] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-85232c6c-cd42-4a15-9924-943a4e75a091" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.894527] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-161889a4-32a2-48ee-8fb7-d2a961a4b28d taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.894871] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.896278] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 11eec8ca-06b2-411c-b25d-c862707f8ca2 with status ACTIVE [ 797.896508] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.896715] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.896827] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.897019] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.897174] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.897797] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.897797] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.897797] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.897797] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.897797] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.898073] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.898073] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.898172] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.898330] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.898389] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.898472] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 11eec8ca-06b2-411c-b25d-c862707f8ca2 is going to be updated. [ 797.923289] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.923445] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.923492] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.923706] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.923862] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.924010] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-11eec8ca-06b2-411c-b25d-c862707f8ca2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.193452] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12a747a0-2898-4059-bada-c453c5c41052 in Status: SUCCESS [ 798.193781] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12a747a0-2898-4059-bada-c453c5c41052" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.193879] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12a747a0-2898-4059-bada-c453c5c41052" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.194135] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12a747a0-2898-4059-bada-c453c5c41052" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.194351] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.194507] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.194611] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.195055] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.195055] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.195055] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12a747a0-2898-4059-bada-c453c5c41052" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.195262] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('12a747a0-2898-4059-bada-c453c5c41052',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.270681] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d in Status: SUCCESS [ 798.270933] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d deletion is rescheduled due to dependency. [ 798.271249] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.271249] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.271434] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.271639] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.271802] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.271914] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.272196] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.272242] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.272348] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('161889a4-32a2-48ee-8fb7-d2a961a4b28d',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.698086] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-12a747a0-2898-4059-bada-c453c5c41052 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.698264] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12a747a0-2898-4059-bada-c453c5c41052" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.698338] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12a747a0-2898-4059-bada-c453c5c41052" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.698596] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12a747a0-2898-4059-bada-c453c5c41052" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.698849] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.698967] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.699098] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.699209] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.699298] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.699391] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12a747a0-2898-4059-bada-c453c5c41052" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.699562] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-12a747a0-2898-4059-bada-c453c5c41052 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.699688] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12a747a0-2898-4059-bada-c453c5c41052" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.699755] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12a747a0-2898-4059-bada-c453c5c41052" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.699909] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12a747a0-2898-4059-bada-c453c5c41052" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.700131] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.700259] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.700321] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.700467] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.700551] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.700636] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12a747a0-2898-4059-bada-c453c5c41052" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.700754] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('12a747a0-2898-4059-bada-c453c5c41052',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.775209] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('161889a4-32a2-48ee-8fb7-d2a961a4b28d',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.202975] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 12a747a0-2898-4059-bada-c453c5c41052: rpc.has_security_group_logging(os_id): False [ 799.223566] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.223765] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.223765] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.223985] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.224101] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.224335] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.224530] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.224604] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.224765] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.224843] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.225079] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.225180] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.225237] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.225399] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.225493] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.225648] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.225741] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.225802] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.225940] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.226022] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.226108] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 12a747a0-2898-4059-bada-c453c5c41052 is going to be created. [ 799.278146] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('161889a4-32a2-48ee-8fb7-d2a961a4b28d',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.301802] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.301962] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.302064] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.302256] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.302440] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.319731] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 12a747a0-2898-4059-bada-c453c5c41052 in Status: IN_PROGRESS for 2s [ 799.781590] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.781822] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.781935] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.782240] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.782376] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.782961] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d is going to be updated. [ 799.820178] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.821081] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.821081] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.821338] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.821470] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.835574] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d in Status: IN_PROGRESS for 2s [ 800.826504] env[65337]: INFO networking_nsxv3.common.synchronization [req-269a2953-492f-4123-a928-4890c7b8c6b7 req-ffa32218-4af4-43ed-8d80-37417487c80d tempest-AttachInterfacesV270Test-1265514655 tempest-AttachInterfacesV270Test-1265514655-project-member] Enqueued Resource ID: b0b56630-897c-40da-8c95-f4c6cd7767d7 with Priority: HIGHEST for action security_group_members [ 800.829300] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0b56630-897c-40da-8c95-f4c6cd7767d7 with Priority: HIGHEST for action security_group_members [ 800.830015] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0b56630-897c-40da-8c95-f4c6cd7767d7 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.830163] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0b56630-897c-40da-8c95-f4c6cd7767d7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.830219] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0b56630-897c-40da-8c95-f4c6cd7767d7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.830487] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0b56630-897c-40da-8c95-f4c6cd7767d7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.830649] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.830771] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.830832] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.831692] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.831692] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.831692] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b0b56630-897c-40da-8c95-f4c6cd7767d7',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.222030] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock network-166 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.222030] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "network-166" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.222030] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "network-166" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.222030] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "network-166" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.222654] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.223037] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.223276] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.223613] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.223968] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.226016] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 801.226016] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 801.226016] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 801.226016] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 801.226016] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 801.226016] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 801.226016] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 801.245636] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 801.246182] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 801.246500] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 801.246851] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "network-166" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.247394] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock port-edced4d4-d3c5-4ca8-9572-79958fc4788a taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.247804] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "port-edced4d4-d3c5-4ca8-9572-79958fc4788a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.248109] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "port-edced4d4-d3c5-4ca8-9572-79958fc4788a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.248626] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "port-edced4d4-d3c5-4ca8-9572-79958fc4788a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.248925] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('edced4d4-d3c5-4ca8-9572-79958fc4788a',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.337041] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.337041] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.337041] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.337041] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.337041] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.337041] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.337041] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.337041] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.337041] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.337041] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.337041] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b0b56630-897c-40da-8c95-f4c6cd7767d7 already deleted. [ 801.338049] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0b56630-897c-40da-8c95-f4c6cd7767d7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.339291] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 12a747a0-2898-4059-bada-c453c5c41052 in Status: SUCCESS [ 801.339628] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-12a747a0-2898-4059-bada-c453c5c41052" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.651900] env[65337]: INFO networking_nsxv3.common.synchronization [req-67187b7b-ab16-4c76-847a-36cc4a119cc3 req-ff9f93c1-063a-4d0a-b18e-2dd8dd1d1ea7 tempest-FloatingIPsAssociationTestJSON-1937565574 tempest-FloatingIPsAssociationTestJSON-1937565574-project-member] Enqueued Resource ID: 3cc33494-7b08-499a-b8bc-a9ae6b25d9d2 with Priority: HIGHEST for action security_group_members [ 801.652827] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cc33494-7b08-499a-b8bc-a9ae6b25d9d2 with Priority: HIGHEST for action security_group_members [ 801.653304] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-3cc33494-7b08-499a-b8bc-a9ae6b25d9d2 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.653484] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3cc33494-7b08-499a-b8bc-a9ae6b25d9d2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.653573] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3cc33494-7b08-499a-b8bc-a9ae6b25d9d2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.653889] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3cc33494-7b08-499a-b8bc-a9ae6b25d9d2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.654138] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.654258] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.654322] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.654543] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.654637] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.654800] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3cc33494-7b08-499a-b8bc-a9ae6b25d9d2',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.751840] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.752758] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.752969] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.753359] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.753569] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.753766] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Segment Port edced4d4-d3c5-4ca8-9572-79958fc4788a not found, creating... [ 801.754211] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.754625] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.754901] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.755370] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.755716] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.756097] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.756300] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.756399] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.756629] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.756889] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.756992] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Resource: SegmentPort with ID: edced4d4-d3c5-4ca8-9572-79958fc4788a is going to be created. [ 801.784552] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.784764] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.785096] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.785375] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.786909] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.786909] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "port-edced4d4-d3c5-4ca8-9572-79958fc4788a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.846634] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d in Status: SUCCESS [ 801.847116] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.847201] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.847388] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.847655] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.847793] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.847793] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.847962] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.847962] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.848100] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.848158] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('161889a4-32a2-48ee-8fb7-d2a961a4b28d',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.159036] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.159036] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.159036] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.159036] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.159036] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.159036] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.159036] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.159036] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.159036] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.159036] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.159036] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3cc33494-7b08-499a-b8bc-a9ae6b25d9d2 is going to be updated. [ 802.191134] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.191134] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.191134] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.191409] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.191507] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.203302] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3cc33494-7b08-499a-b8bc-a9ae6b25d9d2 in Status: IN_PROGRESS for 2s [ 802.352127] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-161889a4-32a2-48ee-8fb7-d2a961a4b28d taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.353606] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.353606] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.353606] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.353606] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.353606] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.353606] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.353606] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.353606] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.353606] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.353606] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-161889a4-32a2-48ee-8fb7-d2a961a4b28d taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.353606] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.353606] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.353606] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.354265] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.354265] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.354265] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.354265] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.354265] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.354265] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.354265] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('161889a4-32a2-48ee-8fb7-d2a961a4b28d',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.529736] env[65337]: INFO networking_nsxv3.common.synchronization [req-269a2953-492f-4123-a928-4890c7b8c6b7 req-1f230ad3-493b-4949-9990-4ffaf8db9bff service nova] Enqueued Resource ID: b0b56630-897c-40da-8c95-f4c6cd7767d7 with Priority: HIGHEST for action security_group_rules [ 802.529736] env[65337]: INFO networking_nsxv3.common.synchronization [req-269a2953-492f-4123-a928-4890c7b8c6b7 req-1f230ad3-493b-4949-9990-4ffaf8db9bff service nova] Enqueued Resource ID: b0b56630-897c-40da-8c95-f4c6cd7767d7 with Priority: HIGHEST for action security_group_members [ 802.529736] env[65337]: INFO networking_nsxv3.common.synchronization [req-269a2953-492f-4123-a928-4890c7b8c6b7 req-1f230ad3-493b-4949-9990-4ffaf8db9bff service nova] Enqueued Resource ID: edced4d4-d3c5-4ca8-9572-79958fc4788a with Priority: HIGHEST for action port [ 802.529736] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0b56630-897c-40da-8c95-f4c6cd7767d7 with Priority: HIGHEST for action security_group_rules [ 802.531113] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0b56630-897c-40da-8c95-f4c6cd7767d7 with Priority: HIGHEST for action security_group_members [ 802.531425] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: edced4d4-d3c5-4ca8-9572-79958fc4788a with Priority: HIGHEST for action port [ 802.532782] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b0b56630-897c-40da-8c95-f4c6cd7767d7 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.532782] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b0b56630-897c-40da-8c95-f4c6cd7767d7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.532782] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b0b56630-897c-40da-8c95-f4c6cd7767d7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.533039] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b0b56630-897c-40da-8c95-f4c6cd7767d7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.533240] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b0b56630-897c-40da-8c95-f4c6cd7767d7',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.535264] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0b56630-897c-40da-8c95-f4c6cd7767d7 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.535264] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0b56630-897c-40da-8c95-f4c6cd7767d7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.535264] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0b56630-897c-40da-8c95-f4c6cd7767d7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.535264] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0b56630-897c-40da-8c95-f4c6cd7767d7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.535264] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.535264] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.535264] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.535264] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.535631] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.535794] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b0b56630-897c-40da-8c95-f4c6cd7767d7',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.537329] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-edced4d4-d3c5-4ca8-9572-79958fc4788a taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.537329] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-edced4d4-d3c5-4ca8-9572-79958fc4788a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.537329] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-edced4d4-d3c5-4ca8-9572-79958fc4788a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.538581] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-edced4d4-d3c5-4ca8-9572-79958fc4788a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.538581] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('edced4d4-d3c5-4ca8-9572-79958fc4788a',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.857154] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 161889a4-32a2-48ee-8fb7-d2a961a4b28d: rpc.has_security_group_logging(os_id): False [ 802.878024] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.878177] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.878238] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.878421] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.878510] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.878693] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.878805] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.878880] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.878985] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.879090] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.879250] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.879343] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.879393] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.879524] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.879596] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.879786] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.879880] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.879940] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.880081] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.880148] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.880229] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d is going to be updated. [ 802.946582] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.946889] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.946889] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.947068] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.947223] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.959624] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d in Status: IN_PROGRESS for 2s [ 803.039345] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b0b56630-897c-40da-8c95-f4c6cd7767d7',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.040790] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0b56630-897c-40da-8c95-f4c6cd7767d7 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.040790] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0b56630-897c-40da-8c95-f4c6cd7767d7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.041273] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port edced4d4-d3c5-4ca8-9572-79958fc4788a with status ACTIVE [ 803.041273] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.041380] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.041459] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.042046] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.042046] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.042046] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.042293] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.042293] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.042548] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.042548] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.042755] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.043001] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.043001] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.043275] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.043275] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.043275] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: edced4d4-d3c5-4ca8-9572-79958fc4788a is going to be updated. [ 803.095461] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.095655] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.095761] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.095942] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.096097] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.096254] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-edced4d4-d3c5-4ca8-9572-79958fc4788a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.542855] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b0b56630-897c-40da-8c95-f4c6cd7767d7',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.046236] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.046522] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.046522] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.046752] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.046842] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.047429] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b0b56630-897c-40da-8c95-f4c6cd7767d7 is going to be created. [ 804.074907] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.074907] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.074907] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.074907] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.074907] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.086489] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0b56630-897c-40da-8c95-f4c6cd7767d7 in Status: UNINITIALIZED for 2s [ 804.214757] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3cc33494-7b08-499a-b8bc-a9ae6b25d9d2 in Status: SUCCESS [ 804.214950] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3cc33494-7b08-499a-b8bc-a9ae6b25d9d2 deletion is rescheduled due to dependency. [ 804.215082] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3cc33494-7b08-499a-b8bc-a9ae6b25d9d2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.974563] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d in Status: SUCCESS [ 804.974563] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.098279] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0b56630-897c-40da-8c95-f4c6cd7767d7 in Status: SUCCESS [ 806.099949] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0b56630-897c-40da-8c95-f4c6cd7767d7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.099949] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0b56630-897c-40da-8c95-f4c6cd7767d7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.099949] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0b56630-897c-40da-8c95-f4c6cd7767d7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.099949] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.099949] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.099949] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.099949] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.099949] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.099949] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0b56630-897c-40da-8c95-f4c6cd7767d7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.100566] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b0b56630-897c-40da-8c95-f4c6cd7767d7',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.602540] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0b56630-897c-40da-8c95-f4c6cd7767d7 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.602698] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0b56630-897c-40da-8c95-f4c6cd7767d7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.602779] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0b56630-897c-40da-8c95-f4c6cd7767d7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.602979] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0b56630-897c-40da-8c95-f4c6cd7767d7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.603167] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.603267] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.603326] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.603466] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.603533] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.603621] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0b56630-897c-40da-8c95-f4c6cd7767d7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.603764] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0b56630-897c-40da-8c95-f4c6cd7767d7 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.603854] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0b56630-897c-40da-8c95-f4c6cd7767d7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.603915] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0b56630-897c-40da-8c95-f4c6cd7767d7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.604118] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0b56630-897c-40da-8c95-f4c6cd7767d7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.604311] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.604452] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.604539] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.604687] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.604777] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.604965] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0b56630-897c-40da-8c95-f4c6cd7767d7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.605069] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b0b56630-897c-40da-8c95-f4c6cd7767d7',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.107151] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b0b56630-897c-40da-8c95-f4c6cd7767d7: rpc.has_security_group_logging(os_id): False [ 807.133519] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.133716] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.133758] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.133950] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.134041] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.134270] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.134371] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.134486] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.134668] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.134748] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.134931] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.135069] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.135133] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.135301] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.135361] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.135559] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.135653] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.135702] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.135863] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.135964] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.136104] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b0b56630-897c-40da-8c95-f4c6cd7767d7 is going to be created. [ 807.210475] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.210720] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.210833] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.211140] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.211398] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.225272] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b0b56630-897c-40da-8c95-f4c6cd7767d7 in Status: IN_PROGRESS for 2s [ 807.475173] env[65337]: INFO networking_nsxv3.common.synchronization [req-9873e928-ba47-4310-b03a-be85fe3d66c2 req-c3920c1d-af0d-45e7-b570-0ca23ce2e7f6 tempest-ServersAdminNegativeTestJSON-683436170 tempest-ServersAdminNegativeTestJSON-683436170-project-member] Enqueued Resource ID: d9afc808-3692-46b5-a84b-018d8d2b7f94 with Priority: HIGHEST for action security_group_members [ 807.475829] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9afc808-3692-46b5-a84b-018d8d2b7f94 with Priority: HIGHEST for action security_group_members [ 807.476151] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9afc808-3692-46b5-a84b-018d8d2b7f94 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.476270] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9afc808-3692-46b5-a84b-018d8d2b7f94" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.476332] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9afc808-3692-46b5-a84b-018d8d2b7f94" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.476530] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9afc808-3692-46b5-a84b-018d8d2b7f94" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.476679] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.476786] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.476859] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.477649] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.477755] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.477856] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d9afc808-3692-46b5-a84b-018d8d2b7f94',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.980530] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d9afc808-3692-46b5-a84b-018d8d2b7f94',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.483258] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d9afc808-3692-46b5-a84b-018d8d2b7f94',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.842339] env[65337]: INFO networking_nsxv3.common.synchronization [req-505208f4-d42d-4241-9a75-13ec5d08a984 req-002da79c-3413-4586-91c9-369c00cbb97b tempest-ServerActionsTestOtherA-84911055 tempest-ServerActionsTestOtherA-84911055-project-member] Enqueued Resource ID: 61142fb1-6124-4f3b-93d1-d1ec51865066 with Priority: HIGHEST for action security_group_members [ 808.842912] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61142fb1-6124-4f3b-93d1-d1ec51865066 with Priority: HIGHEST for action security_group_members [ 808.843229] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-61142fb1-6124-4f3b-93d1-d1ec51865066 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.843435] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-61142fb1-6124-4f3b-93d1-d1ec51865066" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.843435] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-61142fb1-6124-4f3b-93d1-d1ec51865066" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.844245] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-61142fb1-6124-4f3b-93d1-d1ec51865066" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.844245] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.844245] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.844245] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.844544] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.844544] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.844544] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('61142fb1-6124-4f3b-93d1-d1ec51865066',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.988035] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.988035] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.988035] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.988035] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.988035] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.988035] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d9afc808-3692-46b5-a84b-018d8d2b7f94 is going to be updated. [ 809.023357] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.023581] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.023581] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.023785] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.024105] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.036919] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d9afc808-3692-46b5-a84b-018d8d2b7f94 in Status: IN_PROGRESS for 2s [ 809.235910] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock network-393 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.236194] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "network-393" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.236350] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "network-393" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.236612] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "network-393" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.236928] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.237311] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.237443] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.237674] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.237814] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.238035] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 809.238145] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 809.238245] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 809.238346] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 809.238445] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 809.238542] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 809.238676] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 809.241146] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b0b56630-897c-40da-8c95-f4c6cd7767d7 in Status: SUCCESS [ 809.241368] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b0b56630-897c-40da-8c95-f4c6cd7767d7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.267053] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 809.267053] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 809.267053] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 809.267576] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "network-393" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.267739] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock port-cd303741-d763-4289-9e50-33d0182e4761 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.268037] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "port-cd303741-d763-4289-9e50-33d0182e4761" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.268245] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "port-cd303741-d763-4289-9e50-33d0182e4761" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.268734] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "port-cd303741-d763-4289-9e50-33d0182e4761" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.268943] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cd303741-d763-4289-9e50-33d0182e4761',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.348814] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.348814] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.348814] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.348814] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.348814] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.348814] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.348814] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.348814] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.348814] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.348814] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.348814] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 61142fb1-6124-4f3b-93d1-d1ec51865066 already deleted. [ 809.348814] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-61142fb1-6124-4f3b-93d1-d1ec51865066" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.773343] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.773700] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.773889] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.774309] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.774559] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.774801] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Segment Port cd303741-d763-4289-9e50-33d0182e4761 not found, creating... [ 809.775322] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.775533] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.775713] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.776785] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.776785] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.776785] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.776966] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.777132] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.777582] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.777650] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.777862] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Resource: SegmentPort with ID: cd303741-d763-4289-9e50-33d0182e4761 is going to be created. [ 809.805231] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.805769] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.805896] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.806268] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.806394] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.806651] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "port-cd303741-d763-4289-9e50-33d0182e4761" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.595270] env[65337]: INFO networking_nsxv3.common.synchronization [req-505208f4-d42d-4241-9a75-13ec5d08a984 req-bca8a46b-085e-498e-bcc0-8ae5187074c3 service nova] Enqueued Resource ID: 61142fb1-6124-4f3b-93d1-d1ec51865066 with Priority: HIGHEST for action security_group_rules [ 810.595270] env[65337]: INFO networking_nsxv3.common.synchronization [req-505208f4-d42d-4241-9a75-13ec5d08a984 req-bca8a46b-085e-498e-bcc0-8ae5187074c3 service nova] Enqueued Resource ID: 61142fb1-6124-4f3b-93d1-d1ec51865066 with Priority: HIGHEST for action security_group_members [ 810.595270] env[65337]: INFO networking_nsxv3.common.synchronization [req-505208f4-d42d-4241-9a75-13ec5d08a984 req-bca8a46b-085e-498e-bcc0-8ae5187074c3 service nova] Enqueued Resource ID: cd303741-d763-4289-9e50-33d0182e4761 with Priority: HIGHEST for action port [ 810.595270] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61142fb1-6124-4f3b-93d1-d1ec51865066 with Priority: HIGHEST for action security_group_rules [ 810.595270] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61142fb1-6124-4f3b-93d1-d1ec51865066 with Priority: HIGHEST for action security_group_members [ 810.595270] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd303741-d763-4289-9e50-33d0182e4761 with Priority: HIGHEST for action port [ 810.595610] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-61142fb1-6124-4f3b-93d1-d1ec51865066 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.595734] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-61142fb1-6124-4f3b-93d1-d1ec51865066" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.595734] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-61142fb1-6124-4f3b-93d1-d1ec51865066" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.596758] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-61142fb1-6124-4f3b-93d1-d1ec51865066" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.596870] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('61142fb1-6124-4f3b-93d1-d1ec51865066',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.598168] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-61142fb1-6124-4f3b-93d1-d1ec51865066 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.598401] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-61142fb1-6124-4f3b-93d1-d1ec51865066" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.598401] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-61142fb1-6124-4f3b-93d1-d1ec51865066" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.598634] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-61142fb1-6124-4f3b-93d1-d1ec51865066" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.598742] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.598848] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.598904] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.600781] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.601094] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.601094] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('61142fb1-6124-4f3b-93d1-d1ec51865066',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.602228] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-cd303741-d763-4289-9e50-33d0182e4761 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.602228] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cd303741-d763-4289-9e50-33d0182e4761" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.602228] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cd303741-d763-4289-9e50-33d0182e4761" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.602637] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cd303741-d763-4289-9e50-33d0182e4761" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.602637] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cd303741-d763-4289-9e50-33d0182e4761',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.050543] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d9afc808-3692-46b5-a84b-018d8d2b7f94 in Status: SUCCESS [ 811.050926] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9afc808-3692-46b5-a84b-018d8d2b7f94" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.105027] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-61142fb1-6124-4f3b-93d1-d1ec51865066 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.105235] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-61142fb1-6124-4f3b-93d1-d1ec51865066" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.106881] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('61142fb1-6124-4f3b-93d1-d1ec51865066',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.108244] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cd303741-d763-4289-9e50-33d0182e4761 with status ACTIVE [ 811.108474] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.108615] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.108683] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.108912] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.109063] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.109244] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.109363] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.109470] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.109649] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.109745] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.109950] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.110179] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.110179] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.110352] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.110516] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.110618] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cd303741-d763-4289-9e50-33d0182e4761 is going to be updated. [ 811.140342] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.140503] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.140575] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.140779] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.140912] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.141110] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cd303741-d763-4289-9e50-33d0182e4761" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.612807] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('61142fb1-6124-4f3b-93d1-d1ec51865066',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.116654] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.118151] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.118151] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.118151] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.118151] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.118151] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 61142fb1-6124-4f3b-93d1-d1ec51865066 is going to be created. [ 812.150290] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.150290] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.150290] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.150290] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.150290] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.164241] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 61142fb1-6124-4f3b-93d1-d1ec51865066 in Status: UNINITIALIZED for 2s [ 814.106330] env[65337]: INFO networking_nsxv3.common.synchronization [None req-14faa64d-de96-49dd-ac8b-c9ec1232e583 None None] Enqueued Resource ID: f342e8f9-85c5-4cba-bcb9-466a513c53d1 with Priority: HIGHEST for action port [ 814.106996] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f342e8f9-85c5-4cba-bcb9-466a513c53d1 with Priority: HIGHEST for action port [ 814.106996] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-f342e8f9-85c5-4cba-bcb9-466a513c53d1 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.107242] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f342e8f9-85c5-4cba-bcb9-466a513c53d1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.107322] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f342e8f9-85c5-4cba-bcb9-466a513c53d1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.107880] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f342e8f9-85c5-4cba-bcb9-466a513c53d1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.107990] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f342e8f9-85c5-4cba-bcb9-466a513c53d1',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.180816] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 61142fb1-6124-4f3b-93d1-d1ec51865066 in Status: SUCCESS [ 814.181461] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-61142fb1-6124-4f3b-93d1-d1ec51865066" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.181679] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-61142fb1-6124-4f3b-93d1-d1ec51865066" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.181915] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-61142fb1-6124-4f3b-93d1-d1ec51865066" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.182151] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.182279] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.182341] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.182501] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.182594] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.182700] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-61142fb1-6124-4f3b-93d1-d1ec51865066" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.182794] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('61142fb1-6124-4f3b-93d1-d1ec51865066',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.615799] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f342e8f9-85c5-4cba-bcb9-466a513c53d1 [ 814.615799] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.615799] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.615799] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.615799] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.615799] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.615799] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f342e8f9-85c5-4cba-bcb9-466a513c53d1 already deleted. [ 814.615799] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f342e8f9-85c5-4cba-bcb9-466a513c53d1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.687915] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-61142fb1-6124-4f3b-93d1-d1ec51865066 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.688246] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-61142fb1-6124-4f3b-93d1-d1ec51865066" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.688246] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-61142fb1-6124-4f3b-93d1-d1ec51865066" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.688906] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-61142fb1-6124-4f3b-93d1-d1ec51865066" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.688906] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.688906] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.688906] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.689364] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.689364] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.689364] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-61142fb1-6124-4f3b-93d1-d1ec51865066" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.689587] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-61142fb1-6124-4f3b-93d1-d1ec51865066 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.689678] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-61142fb1-6124-4f3b-93d1-d1ec51865066" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.689754] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-61142fb1-6124-4f3b-93d1-d1ec51865066" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.690455] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-61142fb1-6124-4f3b-93d1-d1ec51865066" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.690455] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.690455] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.690455] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.690837] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.690837] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.690837] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-61142fb1-6124-4f3b-93d1-d1ec51865066" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.694299] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('61142fb1-6124-4f3b-93d1-d1ec51865066',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.199458] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 61142fb1-6124-4f3b-93d1-d1ec51865066: rpc.has_security_group_logging(os_id): False [ 815.229178] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.229517] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.229517] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.229708] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.229794] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.230014] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.230176] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.230243] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.230422] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.230647] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.230700] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.230862] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.230862] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.231032] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.231137] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.231366] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.231519] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.231556] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.231832] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.231946] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.232045] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 61142fb1-6124-4f3b-93d1-d1ec51865066 is going to be created. [ 815.337890] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.338064] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.338121] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.338316] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.338490] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.363670] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 61142fb1-6124-4f3b-93d1-d1ec51865066 in Status: IN_PROGRESS for 2s [ 815.854543] env[65337]: INFO networking_nsxv3.common.synchronization [req-fa338d15-ceaa-4624-8bb8-1b8286704dd4 req-bdc7b155-51c9-4661-a89b-11584e582e17 tempest-ServerDiskConfigTestJSON-1745593668 tempest-ServerDiskConfigTestJSON-1745593668-project-member] Enqueued Resource ID: 653446ea-2b31-43b8-a920-884274265c75 with Priority: HIGHEST for action security_group_members [ 815.855338] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 653446ea-2b31-43b8-a920-884274265c75 with Priority: HIGHEST for action security_group_members [ 815.855717] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-653446ea-2b31-43b8-a920-884274265c75 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.855851] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.855909] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.856130] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.856294] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.856411] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.856461] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.856589] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.856675] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.856816] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('653446ea-2b31-43b8-a920-884274265c75',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.361707] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.362223] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.362223] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.362223] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.362360] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.362799] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.363097] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.363097] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.363354] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.363670] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.363874] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 653446ea-2b31-43b8-a920-884274265c75 is going to be updated. [ 816.411140] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.411140] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.411140] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.411530] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.411530] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.426409] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 653446ea-2b31-43b8-a920-884274265c75 in Status: IN_PROGRESS for 2s [ 816.728037] env[65337]: INFO networking_nsxv3.common.synchronization [None req-79e2adbc-1003-4d14-a6a8-d4847ee285c8 None None] Enqueued Resource ID: 8f57e91e-5118-4a6d-902d-c34d2243e9b1 with Priority: HIGHEST for action port [ 816.730038] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f57e91e-5118-4a6d-902d-c34d2243e9b1 with Priority: HIGHEST for action port [ 816.730038] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-8f57e91e-5118-4a6d-902d-c34d2243e9b1 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.730038] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8f57e91e-5118-4a6d-902d-c34d2243e9b1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.730255] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8f57e91e-5118-4a6d-902d-c34d2243e9b1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.730593] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8f57e91e-5118-4a6d-902d-c34d2243e9b1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.730593] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8f57e91e-5118-4a6d-902d-c34d2243e9b1',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.234975] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8f57e91e-5118-4a6d-902d-c34d2243e9b1 [ 817.234975] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.234975] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.234975] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.234975] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.234975] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.234975] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8f57e91e-5118-4a6d-902d-c34d2243e9b1 already deleted. [ 817.234975] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8f57e91e-5118-4a6d-902d-c34d2243e9b1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.292199] env[65337]: INFO networking_nsxv3.common.synchronization [req-2d066479-46b8-4cd5-bdc9-50be36c1d86b req-3fd67cb0-e08d-4342-902a-7d89265de8a9 tempest-SecurityGroupsTestJSON-920822125 tempest-SecurityGroupsTestJSON-920822125-project-member] Enqueued Resource ID: 755f030a-6e7c-43ec-adb9-cb4c270ad532 with Priority: HIGHEST for action security_group_members [ 817.292811] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 755f030a-6e7c-43ec-adb9-cb4c270ad532 with Priority: HIGHEST for action security_group_members [ 817.293132] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-755f030a-6e7c-43ec-adb9-cb4c270ad532 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.293245] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.293439] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.293510] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.293642] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.293738] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.293794] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.294707] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.294707] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.299362] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('755f030a-6e7c-43ec-adb9-cb4c270ad532',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.376033] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 61142fb1-6124-4f3b-93d1-d1ec51865066 in Status: SUCCESS [ 817.376357] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-61142fb1-6124-4f3b-93d1-d1ec51865066" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.687432] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock network-525 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.687623] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "network-525" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.687734] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "network-525" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.687976] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "network-525" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.689519] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.690220] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.690220] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.690359] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.690407] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.690832] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 817.690832] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 817.690832] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 817.690977] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 817.691285] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 817.691285] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 817.691396] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 817.711973] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 817.712166] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 817.712302] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 817.712476] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "network-525" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.712795] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock port-b6d21eab-bc76-4c67-a3f0-6dc71ab10982 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.712963] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "port-b6d21eab-bc76-4c67-a3f0-6dc71ab10982" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.713089] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "port-b6d21eab-bc76-4c67-a3f0-6dc71ab10982" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.713416] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "port-b6d21eab-bc76-4c67-a3f0-6dc71ab10982" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.713555] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b6d21eab-bc76-4c67-a3f0-6dc71ab10982',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.802081] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('755f030a-6e7c-43ec-adb9-cb4c270ad532',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.216470] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.216735] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.216906] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.217207] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.217349] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.217497] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Segment Port b6d21eab-bc76-4c67-a3f0-6dc71ab10982 not found, creating... [ 818.217748] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.218560] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.218560] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.218560] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.218560] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.218792] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.218792] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.218890] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.221061] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.221265] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.221410] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Resource: SegmentPort with ID: b6d21eab-bc76-4c67-a3f0-6dc71ab10982 is going to be created. [ 818.248143] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.248143] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.248143] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.248143] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.248143] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.251684] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "port-b6d21eab-bc76-4c67-a3f0-6dc71ab10982" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.303570] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('755f030a-6e7c-43ec-adb9-cb4c270ad532',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.436751] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 653446ea-2b31-43b8-a920-884274265c75 in Status: SUCCESS [ 818.437113] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 653446ea-2b31-43b8-a920-884274265c75 deletion is rescheduled due to dependency. [ 818.437113] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.570846] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.571074] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.571115] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.571317] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.571415] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.809915] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.810151] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.810311] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.810532] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.810652] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.810733] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 755f030a-6e7c-43ec-adb9-cb4c270ad532 is going to be updated. [ 818.844989] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.845227] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.845324] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.845582] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.845889] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.858019] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 755f030a-6e7c-43ec-adb9-cb4c270ad532 in Status: IN_PROGRESS for 2s [ 819.046447] env[65337]: INFO networking_nsxv3.common.synchronization [req-2d066479-46b8-4cd5-bdc9-50be36c1d86b req-49ce732d-e3aa-43a5-88d4-4f76ef82c5fc service nova] Enqueued Resource ID: 755f030a-6e7c-43ec-adb9-cb4c270ad532 with Priority: HIGHEST for action security_group_rules [ 819.046447] env[65337]: INFO networking_nsxv3.common.synchronization [req-2d066479-46b8-4cd5-bdc9-50be36c1d86b req-49ce732d-e3aa-43a5-88d4-4f76ef82c5fc service nova] Enqueued Resource ID: 755f030a-6e7c-43ec-adb9-cb4c270ad532 with Priority: HIGHEST for action security_group_members [ 819.046447] env[65337]: INFO networking_nsxv3.common.synchronization [req-2d066479-46b8-4cd5-bdc9-50be36c1d86b req-49ce732d-e3aa-43a5-88d4-4f76ef82c5fc service nova] Enqueued Resource ID: b6d21eab-bc76-4c67-a3f0-6dc71ab10982 with Priority: HIGHEST for action port [ 819.048043] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 755f030a-6e7c-43ec-adb9-cb4c270ad532 with Priority: HIGHEST for action security_group_rules [ 819.048328] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 755f030a-6e7c-43ec-adb9-cb4c270ad532 with Priority: HIGHEST for action security_group_members [ 819.048447] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6d21eab-bc76-4c67-a3f0-6dc71ab10982 with Priority: HIGHEST for action port [ 819.050239] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-755f030a-6e7c-43ec-adb9-cb4c270ad532 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.050424] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.050545] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.050894] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.050988] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('755f030a-6e7c-43ec-adb9-cb4c270ad532',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.052288] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-755f030a-6e7c-43ec-adb9-cb4c270ad532 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.052424] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.052752] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-b6d21eab-bc76-4c67-a3f0-6dc71ab10982 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.052937] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b6d21eab-bc76-4c67-a3f0-6dc71ab10982" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.053061] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b6d21eab-bc76-4c67-a3f0-6dc71ab10982" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.053311] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b6d21eab-bc76-4c67-a3f0-6dc71ab10982" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.053395] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b6d21eab-bc76-4c67-a3f0-6dc71ab10982',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.074515] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.489936] env[65337]: INFO networking_nsxv3.common.synchronization [req-10509f4a-4d82-4192-ae2f-78e619ce0306 req-90803a17-8b40-4b9e-a2de-ccf1a1aee28a tempest-ServersAdminTestJSON-283641549 tempest-ServersAdminTestJSON-283641549-project-member] Enqueued Resource ID: 9e889ce7-965a-4de0-b096-60d4e743cf8b with Priority: HIGHEST for action security_group_members [ 819.490642] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e889ce7-965a-4de0-b096-60d4e743cf8b with Priority: HIGHEST for action security_group_members [ 819.491660] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e889ce7-965a-4de0-b096-60d4e743cf8b taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.491826] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.491899] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.492172] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.492405] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.492517] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.492517] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.492714] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.492849] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.493012] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e889ce7-965a-4de0-b096-60d4e743cf8b',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.557191] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-755f030a-6e7c-43ec-adb9-cb4c270ad532 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.557432] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.557677] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b6d21eab-bc76-4c67-a3f0-6dc71ab10982 with status ACTIVE [ 819.557969] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.558154] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.559321] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.559566] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.559661] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.559850] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.559951] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.560031] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.560186] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.560263] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.560484] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.560603] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.560699] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.560887] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.560974] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.564073] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b6d21eab-bc76-4c67-a3f0-6dc71ab10982 is going to be updated. [ 819.579705] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.586367] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.586367] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.586367] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.586609] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.586609] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.587659] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b6d21eab-bc76-4c67-a3f0-6dc71ab10982" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.802076] env[65337]: INFO networking_nsxv3.common.synchronization [req-d6154ccf-5f03-4890-888b-f6c7bf825fbd req-01a27005-0995-449c-87f2-389238b75d90 tempest-AttachInterfacesV270Test-1265514655 tempest-AttachInterfacesV270Test-1265514655-project-member] Enqueued Resource ID: b0b56630-897c-40da-8c95-f4c6cd7767d7 with Priority: HIGHEST for action security_group_members [ 819.802734] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0b56630-897c-40da-8c95-f4c6cd7767d7 with Priority: HIGHEST for action security_group_members [ 819.803412] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0b56630-897c-40da-8c95-f4c6cd7767d7 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.804890] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0b56630-897c-40da-8c95-f4c6cd7767d7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.805060] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0b56630-897c-40da-8c95-f4c6cd7767d7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.805238] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0b56630-897c-40da-8c95-f4c6cd7767d7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.805498] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.805671] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.805753] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.805909] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.806014] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.806125] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b0b56630-897c-40da-8c95-f4c6cd7767d7',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.996358] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9e889ce7-965a-4de0-b096-60d4e743cf8b',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.082865] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 820.083018] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 820.309188] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.309678] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.310036] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.311488] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.311488] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.311488] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.311488] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.311488] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.311488] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.311488] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.311488] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b0b56630-897c-40da-8c95-f4c6cd7767d7 is going to be updated. [ 820.348565] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.348565] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.348565] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.349925] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.350200] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.363923] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0b56630-897c-40da-8c95-f4c6cd7767d7 in Status: IN_PROGRESS for 2s [ 820.406886] env[65337]: INFO networking_nsxv3.common.synchronization [req-cb07ae85-c94b-40e4-899e-282995cb20e6 req-665d4f8c-33c0-4282-b579-727eb1d4fc2b tempest-ImagesOneServerNegativeTestJSON-1864647261 tempest-ImagesOneServerNegativeTestJSON-1864647261-project-member] Enqueued Resource ID: 12a747a0-2898-4059-bada-c453c5c41052 with Priority: HIGHEST for action security_group_members [ 820.406886] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12a747a0-2898-4059-bada-c453c5c41052 with Priority: HIGHEST for action security_group_members [ 820.408419] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-12a747a0-2898-4059-bada-c453c5c41052 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.408419] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12a747a0-2898-4059-bada-c453c5c41052" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.408419] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12a747a0-2898-4059-bada-c453c5c41052" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.408754] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12a747a0-2898-4059-bada-c453c5c41052" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.408831] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.408940] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.409014] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.409306] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.409306] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.409476] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('12a747a0-2898-4059-bada-c453c5c41052',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.500944] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9e889ce7-965a-4de0-b096-60d4e743cf8b',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.871904] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 755f030a-6e7c-43ec-adb9-cb4c270ad532 in Status: SUCCESS [ 820.872700] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.872700] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.872700] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.872971] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.872971] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.873137] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.873203] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.873257] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.873342] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('755f030a-6e7c-43ec-adb9-cb4c270ad532',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.915057] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.915250] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.915250] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.915382] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.915792] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.915792] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.915922] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.915922] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.916087] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.916139] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.916209] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12a747a0-2898-4059-bada-c453c5c41052 is going to be updated. [ 820.947581] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.947581] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.947581] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.947581] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.948034] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.957303] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12a747a0-2898-4059-bada-c453c5c41052 in Status: IN_PROGRESS for 2s [ 821.003902] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.004121] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.004187] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.004367] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.004455] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.004605] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e889ce7-965a-4de0-b096-60d4e743cf8b is going to be updated. [ 821.047547] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.047700] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.047780] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.048032] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.048190] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.059565] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e889ce7-965a-4de0-b096-60d4e743cf8b in Status: IN_PROGRESS for 2s [ 821.100724] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.100724] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.100868] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.100999] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.118789] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 821.120192] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.121452] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 821.153438] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.153736] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.153736] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.153888] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.162956] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.163677] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 821.163778] env[65337]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65337) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 821.164373] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 821.213683] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.213974] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.213974] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.214174] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.216399] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.218177] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 821.336883] env[65337]: INFO networking_nsxv3.common.synchronization [req-79814dec-e5fa-4ade-8906-7e4725cc735b req-e629e898-2094-4c44-9143-fc55f2102234 tempest-ServerRescueTestJSON-1216775078 tempest-ServerRescueTestJSON-1216775078-project-member] Enqueued Resource ID: 85232c6c-cd42-4a15-9924-943a4e75a091 with Priority: HIGHEST for action security_group_members [ 821.339718] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.339979] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.339979] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.340235] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.340527] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.340834] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 821.342492] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85232c6c-cd42-4a15-9924-943a4e75a091 with Priority: HIGHEST for action security_group_members [ 821.342885] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-85232c6c-cd42-4a15-9924-943a4e75a091 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.343018] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85232c6c-cd42-4a15-9924-943a4e75a091" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.343097] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85232c6c-cd42-4a15-9924-943a4e75a091" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.343279] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85232c6c-cd42-4a15-9924-943a4e75a091" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.343471] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.343639] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.343720] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.343913] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.344040] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.344165] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('85232c6c-cd42-4a15-9924-943a4e75a091',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.375448] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('755f030a-6e7c-43ec-adb9-cb4c270ad532',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.480951] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.481175] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.481654] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.481654] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.481753] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.482349] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:37. [ 821.482349] env[65337]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'653446ea-2b31-43b8-a920-884274265c75', '51b69fea-e790-4b59-8a34-41bdb9264f84', 'd8e2d833-6da9-488a-a2b1-f410f4205706', 'd9afc808-3692-46b5-a84b-018d8d2b7f94', '5afc8a2a-3bb1-4c3e-a10b-0941514929b4', 'b2d083bb-47e2-4637-be9f-9dbd7dc68026', '9e889ce7-965a-4de0-b096-60d4e743cf8b', '058c2139-5b77-4965-b2d8-ecc46af22480', 'aacfa5f1-5795-4724-a0b1-919591e92f80', '161889a4-32a2-48ee-8fb7-d2a961a4b28d', '114a6017-3f79-438c-9593-053232b9f176', '1063e362-e6bc-4ee7-8518-83d8fe445cb4', '755f030a-6e7c-43ec-adb9-cb4c270ad532', 'b0b56630-897c-40da-8c95-f4c6cd7767d7', '8a5daf4d-73bf-4ef2-9c95-5aa4dba6c5c3', '88540781-e606-4e3c-87fb-e6581cf39d0d', '2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24', '9282454d-037f-4e64-902c-636a49b89434', '13c1490a-eab4-4d63-8d39-9071228c67fc', 'd4ff60fe-3407-42aa-b33c-6254779ad495', '7db87dc2-69af-45f1-90c2-f8a4ec96c3b7', 'ee03c436-a01f-49f3-9012-42ca1b72c1d4', '3cc33494-7b08-499a-b8bc-a9ae6b25d9d2', 'ebb204e1-ff28-4709-a165-ad95f8c27d8b', '5289c470-2cbe-4957-bd37-f39138ab0a31', '85232c6c-cd42-4a15-9924-943a4e75a091', '4f8577ef-eb55-481e-9197-98761298b164', 'a4c4fbaa-f4c9-4326-babb-bda6619acdf6', '4fe2934b-ab8b-4bda-9010-1a9725b2c40c', 'b2e84376-5c9f-45e7-9949-59bf17a96c95', '5f3badd2-7106-4670-baaf-51e2d735f908', 'b5288296-022e-4f32-a68e-bdef9f09be4e', '61142fb1-6124-4f3b-93d1-d1ec51865066', '94a13e53-dcf7-4643-ade4-8789dc9eabc4', 'c26a679a-9c5d-4a72-b91b-bd7f21348ea0', 'a4a9546d-8cbc-404d-acef-d7856f353fbe', '12a747a0-2898-4059-bada-c453c5c41052'} {{(pid=65337) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 821.482349] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 821.519167] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.519692] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.519692] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.519948] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.520100] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.520289] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 821.520391] env[65337]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65337) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 821.520481] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 821.611200] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.611200] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.611200] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.611977] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.613094] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.613673] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 821.613875] env[65337]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65337) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 821.614117] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 821.614340] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 821.614723] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/37 resources of Type:Security Group Rules [ 821.615316] env[65337]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 653446ea-2b31-43b8-a920-884274265c75 with Priority: HIGH for action security_group_rules [ 821.616876] env[65337]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 51b69fea-e790-4b59-8a34-41bdb9264f84 with Priority: HIGH for action security_group_rules [ 821.616876] env[65337]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d8e2d833-6da9-488a-a2b1-f410f4205706 with Priority: HIGH for action security_group_rules [ 821.616876] env[65337]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d9afc808-3692-46b5-a84b-018d8d2b7f94 with Priority: HIGH for action security_group_rules [ 821.616876] env[65337]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5afc8a2a-3bb1-4c3e-a10b-0941514929b4 with Priority: HIGH for action security_group_rules [ 821.616876] env[65337]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b2d083bb-47e2-4637-be9f-9dbd7dc68026 with Priority: HIGH for action security_group_rules [ 821.616876] env[65337]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9e889ce7-965a-4de0-b096-60d4e743cf8b with Priority: HIGH for action security_group_rules [ 821.617157] env[65337]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 058c2139-5b77-4965-b2d8-ecc46af22480 with Priority: HIGH for action security_group_rules [ 821.617157] env[65337]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: aacfa5f1-5795-4724-a0b1-919591e92f80 with Priority: HIGH for action security_group_rules [ 821.617157] env[65337]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d with Priority: HIGH for action security_group_rules [ 821.617157] env[65337]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 114a6017-3f79-438c-9593-053232b9f176 with Priority: HIGH for action security_group_rules [ 821.617280] env[65337]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1063e362-e6bc-4ee7-8518-83d8fe445cb4 with Priority: HIGH for action security_group_rules [ 821.617280] env[65337]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 755f030a-6e7c-43ec-adb9-cb4c270ad532 with Priority: HIGH for action security_group_rules [ 821.617342] env[65337]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b0b56630-897c-40da-8c95-f4c6cd7767d7 with Priority: HIGH for action security_group_rules [ 821.617373] env[65337]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8a5daf4d-73bf-4ef2-9c95-5aa4dba6c5c3 with Priority: HIGH for action security_group_rules [ 821.617452] env[65337]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 88540781-e606-4e3c-87fb-e6581cf39d0d with Priority: HIGH for action security_group_rules [ 821.617452] env[65337]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24 with Priority: HIGH for action security_group_rules [ 821.617587] env[65337]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9282454d-037f-4e64-902c-636a49b89434 with Priority: HIGH for action security_group_rules [ 821.617587] env[65337]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 13c1490a-eab4-4d63-8d39-9071228c67fc with Priority: HIGH for action security_group_rules [ 821.617678] env[65337]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d4ff60fe-3407-42aa-b33c-6254779ad495 with Priority: HIGH for action security_group_rules [ 821.617767] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.848053] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('85232c6c-cd42-4a15-9924-943a4e75a091',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.878455] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('755f030a-6e7c-43ec-adb9-cb4c270ad532',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.938661] env[65337]: INFO networking_nsxv3.common.synchronization [req-5a8ba185-7f6e-4a01-99d3-56f8b7dda93e req-85f4f172-3a01-4777-8db6-9ba7f2e4bfda tempest-DeleteServersTestJSON-1654690426 tempest-DeleteServersTestJSON-1654690426-project-member] Enqueued Resource ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d with Priority: HIGHEST for action security_group_members [ 821.939249] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d with Priority: HIGHEST for action security_group_members [ 821.939421] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 653446ea-2b31-43b8-a920-884274265c75 with Priority: HIGH for action security_group_rules [ 821.939520] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8e2d833-6da9-488a-a2b1-f410f4205706 with Priority: HIGH for action security_group_rules [ 821.939616] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e889ce7-965a-4de0-b096-60d4e743cf8b with Priority: HIGH for action security_group_rules [ 821.939732] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a5daf4d-73bf-4ef2-9c95-5aa4dba6c5c3 with Priority: HIGH for action security_group_rules [ 821.939832] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4ff60fe-3407-42aa-b33c-6254779ad495 with Priority: HIGH for action security_group_rules [ 821.939921] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13c1490a-eab4-4d63-8d39-9071228c67fc with Priority: HIGH for action security_group_rules [ 821.940014] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9282454d-037f-4e64-902c-636a49b89434 with Priority: HIGH for action security_group_rules [ 821.940119] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24 with Priority: HIGH for action security_group_rules [ 821.940186] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0b56630-897c-40da-8c95-f4c6cd7767d7 with Priority: HIGH for action security_group_rules [ 821.940270] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88540781-e606-4e3c-87fb-e6581cf39d0d with Priority: HIGH for action security_group_rules [ 821.940353] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 755f030a-6e7c-43ec-adb9-cb4c270ad532 with Priority: HIGH for action security_group_rules [ 821.940437] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1063e362-e6bc-4ee7-8518-83d8fe445cb4 with Priority: HIGH for action security_group_rules [ 821.940521] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 114a6017-3f79-438c-9593-053232b9f176 with Priority: HIGH for action security_group_rules [ 821.940873] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d with Priority: HIGH for action security_group_rules [ 821.941027] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aacfa5f1-5795-4724-a0b1-919591e92f80 with Priority: HIGH for action security_group_rules [ 821.941109] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2d083bb-47e2-4637-be9f-9dbd7dc68026 with Priority: HIGH for action security_group_rules [ 821.941200] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 058c2139-5b77-4965-b2d8-ecc46af22480 with Priority: HIGH for action security_group_rules [ 821.941286] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5afc8a2a-3bb1-4c3e-a10b-0941514929b4 with Priority: HIGH for action security_group_rules [ 821.941371] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51b69fea-e790-4b59-8a34-41bdb9264f84 with Priority: HIGH for action security_group_rules [ 821.941458] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9afc808-3692-46b5-a84b-018d8d2b7f94 with Priority: HIGH for action security_group_rules [ 821.941728] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-161889a4-32a2-48ee-8fb7-d2a961a4b28d taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.941846] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.941911] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.942130] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.942285] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.942406] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.942491] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.942633] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.942706] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.942802] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('161889a4-32a2-48ee-8fb7-d2a961a4b28d',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.944175] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-653446ea-2b31-43b8-a920-884274265c75 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.944311] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.944379] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.944643] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.944688] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('653446ea-2b31-43b8-a920-884274265c75',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.946742] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d8e2d833-6da9-488a-a2b1-f410f4205706 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.946742] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d8e2d833-6da9-488a-a2b1-f410f4205706" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.946742] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d8e2d833-6da9-488a-a2b1-f410f4205706" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.946742] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d8e2d833-6da9-488a-a2b1-f410f4205706" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.946742] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d8e2d833-6da9-488a-a2b1-f410f4205706',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.948452] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9e889ce7-965a-4de0-b096-60d4e743cf8b taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.948452] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.948452] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.948452] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.948452] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9e889ce7-965a-4de0-b096-60d4e743cf8b',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.950171] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8a5daf4d-73bf-4ef2-9c95-5aa4dba6c5c3 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.950171] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8a5daf4d-73bf-4ef2-9c95-5aa4dba6c5c3" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.950171] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8a5daf4d-73bf-4ef2-9c95-5aa4dba6c5c3" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.950390] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8a5daf4d-73bf-4ef2-9c95-5aa4dba6c5c3" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.950451] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8a5daf4d-73bf-4ef2-9c95-5aa4dba6c5c3',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.951874] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d4ff60fe-3407-42aa-b33c-6254779ad495 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.951874] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d4ff60fe-3407-42aa-b33c-6254779ad495" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.952072] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d4ff60fe-3407-42aa-b33c-6254779ad495" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.952113] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d4ff60fe-3407-42aa-b33c-6254779ad495" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.952476] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d4ff60fe-3407-42aa-b33c-6254779ad495',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.953492] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-13c1490a-eab4-4d63-8d39-9071228c67fc taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.953626] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-13c1490a-eab4-4d63-8d39-9071228c67fc" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.953694] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-13c1490a-eab4-4d63-8d39-9071228c67fc" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.953986] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-13c1490a-eab4-4d63-8d39-9071228c67fc" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.953986] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('13c1490a-eab4-4d63-8d39-9071228c67fc',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.954865] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9282454d-037f-4e64-902c-636a49b89434 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.955783] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9282454d-037f-4e64-902c-636a49b89434" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.955783] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9282454d-037f-4e64-902c-636a49b89434" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.956025] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9282454d-037f-4e64-902c-636a49b89434" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.956107] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9282454d-037f-4e64-902c-636a49b89434',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.957388] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.957388] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.957388] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.957388] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.957388] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.958942] env[65337]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20 [ 821.958942] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b0b56630-897c-40da-8c95-f4c6cd7767d7 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.958942] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b0b56630-897c-40da-8c95-f4c6cd7767d7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.958942] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b0b56630-897c-40da-8c95-f4c6cd7767d7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.958942] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b0b56630-897c-40da-8c95-f4c6cd7767d7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.958942] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b0b56630-897c-40da-8c95-f4c6cd7767d7',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.961047] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-88540781-e606-4e3c-87fb-e6581cf39d0d taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.961154] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-88540781-e606-4e3c-87fb-e6581cf39d0d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.961275] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-88540781-e606-4e3c-87fb-e6581cf39d0d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.961397] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-88540781-e606-4e3c-87fb-e6581cf39d0d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.961462] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('88540781-e606-4e3c-87fb-e6581cf39d0d',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.965604] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-755f030a-6e7c-43ec-adb9-cb4c270ad532 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.965604] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.965604] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1063e362-e6bc-4ee7-8518-83d8fe445cb4 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.965604] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1063e362-e6bc-4ee7-8518-83d8fe445cb4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.965604] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1063e362-e6bc-4ee7-8518-83d8fe445cb4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.965937] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1063e362-e6bc-4ee7-8518-83d8fe445cb4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.965937] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1063e362-e6bc-4ee7-8518-83d8fe445cb4',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.967103] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-114a6017-3f79-438c-9593-053232b9f176 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.967225] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-114a6017-3f79-438c-9593-053232b9f176" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.967318] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-114a6017-3f79-438c-9593-053232b9f176" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.967460] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-114a6017-3f79-438c-9593-053232b9f176" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.967594] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('114a6017-3f79-438c-9593-053232b9f176',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.969632] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-161889a4-32a2-48ee-8fb7-d2a961a4b28d taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.969632] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.969632] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.969632] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.969632] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('161889a4-32a2-48ee-8fb7-d2a961a4b28d',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.970634] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aacfa5f1-5795-4724-a0b1-919591e92f80 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.970799] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aacfa5f1-5795-4724-a0b1-919591e92f80" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.970890] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aacfa5f1-5795-4724-a0b1-919591e92f80" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.971584] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aacfa5f1-5795-4724-a0b1-919591e92f80" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.971584] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aacfa5f1-5795-4724-a0b1-919591e92f80',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.128320] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b2d083bb-47e2-4637-be9f-9dbd7dc68026 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.128701] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b2d083bb-47e2-4637-be9f-9dbd7dc68026" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.128701] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b2d083bb-47e2-4637-be9f-9dbd7dc68026" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.128977] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b2d083bb-47e2-4637-be9f-9dbd7dc68026" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.128977] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b2d083bb-47e2-4637-be9f-9dbd7dc68026',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.130166] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-058c2139-5b77-4965-b2d8-ecc46af22480 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.130330] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-058c2139-5b77-4965-b2d8-ecc46af22480" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.130439] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-058c2139-5b77-4965-b2d8-ecc46af22480" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.130679] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-058c2139-5b77-4965-b2d8-ecc46af22480" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.130714] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('058c2139-5b77-4965-b2d8-ecc46af22480',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.131880] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5afc8a2a-3bb1-4c3e-a10b-0941514929b4 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.132019] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5afc8a2a-3bb1-4c3e-a10b-0941514929b4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.132916] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5afc8a2a-3bb1-4c3e-a10b-0941514929b4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.133150] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5afc8a2a-3bb1-4c3e-a10b-0941514929b4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.133288] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5afc8a2a-3bb1-4c3e-a10b-0941514929b4',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.135161] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-51b69fea-e790-4b59-8a34-41bdb9264f84 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.135294] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-51b69fea-e790-4b59-8a34-41bdb9264f84" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.135460] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-51b69fea-e790-4b59-8a34-41bdb9264f84" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.135729] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-51b69fea-e790-4b59-8a34-41bdb9264f84" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.135729] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('51b69fea-e790-4b59-8a34-41bdb9264f84',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.135968] env[65337]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 21, greater than warning threshold: 20. There could be a leak. Increasing threshold to: 40 [ 822.136915] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d9afc808-3692-46b5-a84b-018d8d2b7f94 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.137054] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d9afc808-3692-46b5-a84b-018d8d2b7f94" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.137101] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d9afc808-3692-46b5-a84b-018d8d2b7f94" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.137268] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d9afc808-3692-46b5-a84b-018d8d2b7f94" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.137336] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d9afc808-3692-46b5-a84b-018d8d2b7f94',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.146740] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.146912] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.146912] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.147045] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.179950] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.179950] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.180110] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.180110] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.180370] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.180451] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.180551] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d is going to be updated. [ 822.212138] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.212353] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.212397] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.212665] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.212834] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.224094] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d in Status: IN_PROGRESS for 2s [ 822.352173] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('85232c6c-cd42-4a15-9924-943a4e75a091',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.375630] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0b56630-897c-40da-8c95-f4c6cd7767d7 in Status: SUCCESS [ 822.375630] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b0b56630-897c-40da-8c95-f4c6cd7767d7 deletion is rescheduled due to dependency. [ 822.375630] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0b56630-897c-40da-8c95-f4c6cd7767d7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.381391] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.381391] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.381391] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.381620] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.381697] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.381773] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 755f030a-6e7c-43ec-adb9-cb4c270ad532 is going to be updated. [ 822.410576] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.410756] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.410806] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.411065] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.411242] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.423248] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 755f030a-6e7c-43ec-adb9-cb4c270ad532 in Status: IN_PROGRESS for 2s [ 822.632905] env[65337]: INFO networking_nsxv3.common.synchronization [req-044532ae-392f-4ecb-9677-27ecc7ec81a4 req-561cf0d5-9746-4aa1-9674-5dfe6f800e48 tempest-ServersTestBootFromVolume-1626214960 tempest-ServersTestBootFromVolume-1626214960-project-member] Enqueued Resource ID: 4fe2934b-ab8b-4bda-9010-1a9725b2c40c with Priority: HIGHEST for action security_group_members [ 822.633915] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fe2934b-ab8b-4bda-9010-1a9725b2c40c with Priority: HIGHEST for action security_group_members [ 822.634554] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fe2934b-ab8b-4bda-9010-1a9725b2c40c taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.634665] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fe2934b-ab8b-4bda-9010-1a9725b2c40c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.634713] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fe2934b-ab8b-4bda-9010-1a9725b2c40c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.634983] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fe2934b-ab8b-4bda-9010-1a9725b2c40c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.635558] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.635558] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.635558] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.635781] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.635901] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.636049] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4fe2934b-ab8b-4bda-9010-1a9725b2c40c',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.642241] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8e2d833-6da9-488a-a2b1-f410f4205706 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.643041] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8e2d833-6da9-488a-a2b1-f410f4205706" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.643041] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8e2d833-6da9-488a-a2b1-f410f4205706" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.643041] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8e2d833-6da9-488a-a2b1-f410f4205706" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.643041] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.643274] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.643274] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.643341] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.643521] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.643686] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8e2d833-6da9-488a-a2b1-f410f4205706" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.643734] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d8e2d833-6da9-488a-a2b1-f410f4205706',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.663636] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.663941] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.664070] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.664309] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.685153] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.685590] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.685590] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.685731] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.685897] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.685998] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.686090] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.686242] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.686328] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.686414] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.686510] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.688664] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.688664] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 653446ea-2b31-43b8-a920-884274265c75 is going to be deleted. [ 822.698587] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e889ce7-965a-4de0-b096-60d4e743cf8b taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.698780] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.700197] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4ff60fe-3407-42aa-b33c-6254779ad495 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.700341] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4ff60fe-3407-42aa-b33c-6254779ad495" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.700405] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4ff60fe-3407-42aa-b33c-6254779ad495" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.700741] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4ff60fe-3407-42aa-b33c-6254779ad495" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.700741] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.701185] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.701185] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.701185] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.701340] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.701340] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4ff60fe-3407-42aa-b33c-6254779ad495" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.701416] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d4ff60fe-3407-42aa-b33c-6254779ad495',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.707514] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9afc808-3692-46b5-a84b-018d8d2b7f94 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.707649] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9afc808-3692-46b5-a84b-018d8d2b7f94" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.707702] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9afc808-3692-46b5-a84b-018d8d2b7f94" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.707892] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9afc808-3692-46b5-a84b-018d8d2b7f94" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.708073] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.708464] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.708519] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.708659] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.708749] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.708946] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9afc808-3692-46b5-a84b-018d8d2b7f94" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.709028] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d9afc808-3692-46b5-a84b-018d8d2b7f94',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.722450] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d4ff60fe-3407-42aa-b33c-6254779ad495',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.766999] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.767209] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.767254] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.767540] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.769524] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.769734] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.771067] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.771161] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.771534] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.771629] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.772781] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.772846] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.774090] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.774187] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.775420] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.775420] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.778588] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.778588] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.778588] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.778588] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.778588] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.778588] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.779733] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.779839] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.794685] env[65337]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 822.796168] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.796168] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.810682] env[65337]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 822.811323] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.811497] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.820472] env[65337]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 822.820597] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.820802] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 88540781-e606-4e3c-87fb-e6581cf39d0d is going to be deleted. [ 822.822251] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.822371] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.845073] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.845501] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.848690] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.848690] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 058c2139-5b77-4965-b2d8-ecc46af22480 is going to be deleted. [ 822.849529] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.849699] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.854134] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.854312] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.854473] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.854973] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.854973] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.854973] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85232c6c-cd42-4a15-9924-943a4e75a091 is going to be updated. [ 822.872278] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.876203] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b0b56630-897c-40da-8c95-f4c6cd7767d7 is going to be deleted. [ 822.877329] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.877776] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.877776] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.877776] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d is going to be deleted. [ 822.879502] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.879706] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.909352] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.909580] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.909635] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.909894] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.910059] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.912059] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.912306] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.927525] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.927705] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 13c1490a-eab4-4d63-8d39-9071228c67fc is going to be deleted. [ 822.928780] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.929034] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.930412] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85232c6c-cd42-4a15-9924-943a4e75a091 in Status: IN_PROGRESS for 2s [ 822.959251] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.959446] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.984393] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.984603] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aacfa5f1-5795-4724-a0b1-919591e92f80 is going to be deleted. [ 822.985905] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.986237] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.987903] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.988022] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.991892] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.992137] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.998245] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12a747a0-2898-4059-bada-c453c5c41052 in Status: SUCCESS [ 822.998245] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12a747a0-2898-4059-bada-c453c5c41052 deletion is rescheduled due to dependency. [ 822.998245] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12a747a0-2898-4059-bada-c453c5c41052" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.026725] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.026725] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5afc8a2a-3bb1-4c3e-a10b-0941514929b4 is going to be deleted. [ 823.026725] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.026725] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.064125] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.064125] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9282454d-037f-4e64-902c-636a49b89434 is going to be deleted. [ 823.065149] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.065371] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.075491] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e889ce7-965a-4de0-b096-60d4e743cf8b in Status: SUCCESS [ 823.075491] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.075491] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.075974] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.075974] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.075974] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.075974] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.076547] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.076547] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.076547] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.076547] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9e889ce7-965a-4de0-b096-60d4e743cf8b',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.085976] env[65337]: INFO networking_nsxv3.common.synchronization [req-efc86617-f363-4315-85ff-9c723564b69c req-5302a87d-8449-4db8-8b58-db4caa61d1ea tempest-InstanceActionsNegativeTestJSON-1572947405 tempest-InstanceActionsNegativeTestJSON-1572947405-project-member] Enqueued Resource ID: 8e29edb7-88ed-486f-9fa2-5fb50a0857b5 with Priority: HIGHEST for action security_group_members [ 823.086659] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e29edb7-88ed-486f-9fa2-5fb50a0857b5 with Priority: HIGHEST for action security_group_members [ 823.087305] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e29edb7-88ed-486f-9fa2-5fb50a0857b5 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.087305] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e29edb7-88ed-486f-9fa2-5fb50a0857b5" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.087305] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e29edb7-88ed-486f-9fa2-5fb50a0857b5" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.087662] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e29edb7-88ed-486f-9fa2-5fb50a0857b5" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.087662] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.087662] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.087930] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.087930] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.087930] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.088368] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8e29edb7-88ed-486f-9fa2-5fb50a0857b5',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.112472] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.112472] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 51b69fea-e790-4b59-8a34-41bdb9264f84 is going to be deleted. [ 823.112472] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.112472] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.139168] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.139168] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.145987] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8e2d833-6da9-488a-a2b1-f410f4205706 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.145987] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8e2d833-6da9-488a-a2b1-f410f4205706" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.145987] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8e2d833-6da9-488a-a2b1-f410f4205706" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.146279] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8e2d833-6da9-488a-a2b1-f410f4205706" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.146374] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.146435] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.146503] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.146645] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.146762] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.146832] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8e2d833-6da9-488a-a2b1-f410f4205706" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.146964] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8e2d833-6da9-488a-a2b1-f410f4205706 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.147379] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8e2d833-6da9-488a-a2b1-f410f4205706" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.147379] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8e2d833-6da9-488a-a2b1-f410f4205706" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.147379] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8e2d833-6da9-488a-a2b1-f410f4205706" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.147379] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.147535] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.147535] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.147660] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.147766] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.147814] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8e2d833-6da9-488a-a2b1-f410f4205706" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.147916] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d8e2d833-6da9-488a-a2b1-f410f4205706',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.191121] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.191354] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.192492] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.192492] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.220262] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.220468] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.220525] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.220734] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.220914] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.221106] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.221106] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.221264] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.221378] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.221433] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.221608] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.221665] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.221717] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.221858] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.221993] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.222103] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.222162] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.222491] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.222670] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.222721] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.222828] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.224565] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.224687] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8a5daf4d-73bf-4ef2-9c95-5aa4dba6c5c3 is going to be deleted. [ 823.226561] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.226772] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.228457] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d4ff60fe-3407-42aa-b33c-6254779ad495: rpc.has_security_group_logging(os_id): False [ 823.229105] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9afc808-3692-46b5-a84b-018d8d2b7f94 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.229293] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9afc808-3692-46b5-a84b-018d8d2b7f94" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.229293] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9afc808-3692-46b5-a84b-018d8d2b7f94" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.230357] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9afc808-3692-46b5-a84b-018d8d2b7f94" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.230451] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.230574] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.234164] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.234464] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.234606] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.234721] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9afc808-3692-46b5-a84b-018d8d2b7f94" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.234978] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9afc808-3692-46b5-a84b-018d8d2b7f94 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.235097] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9afc808-3692-46b5-a84b-018d8d2b7f94" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.235190] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9afc808-3692-46b5-a84b-018d8d2b7f94" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.235385] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9afc808-3692-46b5-a84b-018d8d2b7f94" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.235566] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.235717] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.235778] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.235923] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.236045] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.236156] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9afc808-3692-46b5-a84b-018d8d2b7f94" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.236274] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d9afc808-3692-46b5-a84b-018d8d2b7f94',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.264358] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.264571] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.267814] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.267979] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.275392] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.275957] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b2d083bb-47e2-4637-be9f-9dbd7dc68026 is going to be deleted. [ 823.277338] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.277555] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.281890] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.282060] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.381821] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.381821] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.394182] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.394384] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 114a6017-3f79-438c-9593-053232b9f176 is going to be deleted. [ 823.395618] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.395774] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.412128] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.412128] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.480856] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.480995] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1063e362-e6bc-4ee7-8518-83d8fe445cb4 is going to be deleted. [ 823.482166] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.482412] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.482576] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.482638] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.484798] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.484798] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.484798] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.484798] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-88540781-e606-4e3c-87fb-e6581cf39d0d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.484798] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.484798] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.484798] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.484798] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-058c2139-5b77-4965-b2d8-ecc46af22480" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.484798] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.484798] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.484798] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.484798] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.484798] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.485923] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.485923] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.485923] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b0b56630-897c-40da-8c95-f4c6cd7767d7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.485923] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.485923] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.499383] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock network-888 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.499383] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "network-888" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.499383] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "network-888" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.499383] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "network-888" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.499628] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.499793] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.499893] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.500152] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.500303] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.501031] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 823.501031] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 823.501031] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 823.501215] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 823.501215] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 823.501356] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 823.501356] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 823.546751] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.546946] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.547073] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.547172] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.547482] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.547607] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.547673] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4fe2934b-ab8b-4bda-9010-1a9725b2c40c is going to be updated. [ 823.552437] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.552437] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.552437] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.552437] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aacfa5f1-5795-4724-a0b1-919591e92f80" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.552437] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.552437] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.552437] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.553081] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-13c1490a-eab4-4d63-8d39-9071228c67fc" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.554124] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.554124] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.554124] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.554370] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5afc8a2a-3bb1-4c3e-a10b-0941514929b4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.554591] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.554845] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.554988] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.555187] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9282454d-037f-4e64-902c-636a49b89434" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.555404] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.555935] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.578670] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e889ce7-965a-4de0-b096-60d4e743cf8b taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.578888] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.578888] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.579185] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.579386] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.579585] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.579585] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.580303] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.580431] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.580558] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.580711] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e889ce7-965a-4de0-b096-60d4e743cf8b taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.580809] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.580862] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.581066] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.581291] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.581583] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.581583] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.581583] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.581733] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.581733] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.581830] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9e889ce7-965a-4de0-b096-60d4e743cf8b',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.590238] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 823.590636] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Cache value generated in 0.089 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 823.590636] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 823.590810] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "network-888" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.591104] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock port-3e993003-61be-49f7-bbf4-1203691ee1ab taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.591276] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "port-3e993003-61be-49f7-bbf4-1203691ee1ab" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.591427] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "port-3e993003-61be-49f7-bbf4-1203691ee1ab" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.591861] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "port-3e993003-61be-49f7-bbf4-1203691ee1ab" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.591861] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e993003-61be-49f7-bbf4-1203691ee1ab',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.593937] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.593937] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.594230] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.594230] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.595133] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.595287] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.608837] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.609419] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.609636] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.609730] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.610087] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.610087] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.610198] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d4ff60fe-3407-42aa-b33c-6254779ad495 is going to be updated. [ 823.611961] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.612197] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.612291] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.612415] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-51b69fea-e790-4b59-8a34-41bdb9264f84" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.612555] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.612736] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.612853] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.612933] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8a5daf4d-73bf-4ef2-9c95-5aa4dba6c5c3" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.615578] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.615578] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.615578] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.615578] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.615578] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.619984] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.619984] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.619984] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.619984] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.619984] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.619984] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.619984] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.619984] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.619984] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8e29edb7-88ed-486f-9fa2-5fb50a0857b5 already deleted. [ 823.619984] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e29edb7-88ed-486f-9fa2-5fb50a0857b5" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.619984] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.619984] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.619984] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.619984] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b2d083bb-47e2-4637-be9f-9dbd7dc68026" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.622754] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.622754] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.622754] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.622754] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-114a6017-3f79-438c-9593-053232b9f176" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.638301] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4fe2934b-ab8b-4bda-9010-1a9725b2c40c in Status: IN_PROGRESS for 2s [ 823.645122] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.645344] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.645344] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.645842] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.645842] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.646000] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1063e362-e6bc-4ee7-8518-83d8fe445cb4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.650366] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d8e2d833-6da9-488a-a2b1-f410f4205706: rpc.has_security_group_logging(os_id): False [ 823.688361] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.688500] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.688569] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.688782] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.728883] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24: rpc.has_security_group_logging(os_id): False [ 823.739557] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d9afc808-3692-46b5-a84b-018d8d2b7f94: rpc.has_security_group_logging(os_id): False [ 823.764308] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.764697] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.764829] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.764895] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.765137] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.765223] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.765436] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.765566] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.765636] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.765802] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.765877] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.766141] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.766214] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.766249] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.766386] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.766472] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.766558] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d8e2d833-6da9-488a-a2b1-f410f4205706 is going to be updated. [ 823.768836] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.768950] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.769044] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.769214] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.771673] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.771800] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.772886] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.773177] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.807944] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.808247] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.808393] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.808486] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.808664] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.808748] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.808966] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.809209] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.809209] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.809354] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.809388] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.809602] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.809742] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.809742] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.809934] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.809934] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.810048] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24 is going to be updated. [ 823.811209] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.811414] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.870825] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.871045] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.876671] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.876960] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.877107] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.877173] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.877397] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.877480] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.877708] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.877827] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.877891] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.878058] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.878136] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.878347] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.878439] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.878502] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.878660] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.878734] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.878838] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d9afc808-3692-46b5-a84b-018d8d2b7f94 is going to be updated. [ 823.879998] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.880256] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.880426] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.881451] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.881630] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.881761] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.905470] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d4ff60fe-3407-42aa-b33c-6254779ad495 in Status: IN_PROGRESS for 2s [ 823.906048] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d8e2d833-6da9-488a-a2b1-f410f4205706 in Status: IN_PROGRESS for 2s [ 823.942452] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.942716] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.942716] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.942965] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.943158] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.955275] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24 in Status: IN_PROGRESS for 2s [ 823.969725] env[65337]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 823.970602] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.970816] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.970883] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.971113] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.971282] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.991098] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d9afc808-3692-46b5-a84b-018d8d2b7f94 in Status: IN_PROGRESS for 2s [ 824.086101] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9e889ce7-965a-4de0-b096-60d4e743cf8b: rpc.has_security_group_logging(os_id): False [ 824.096710] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.096964] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.097101] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.097374] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.097526] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.097679] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Segment Port 3e993003-61be-49f7-bbf4-1203691ee1ab not found, creating... [ 824.097951] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.098124] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.098239] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.098462] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.098594] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.098912] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.099095] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.099211] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.099415] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.099548] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.099684] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Resource: SegmentPort with ID: 3e993003-61be-49f7-bbf4-1203691ee1ab is going to be created. [ 824.112138] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.112660] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.112660] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.112660] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.126677] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.127145] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.127145] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.127337] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.127561] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.128650] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "port-3e993003-61be-49f7-bbf4-1203691ee1ab" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.142254] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.142563] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.142680] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.142749] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.142948] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.143041] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.143325] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.143401] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.143437] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.143576] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.143651] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.143906] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.144011] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.144075] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.144211] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.144286] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.144369] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9e889ce7-965a-4de0-b096-60d4e743cf8b is going to be updated. [ 824.246511] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d in Status: IN_PROGRESS for 4s [ 824.253339] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.253339] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.253641] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.253680] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.253832] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.284387] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9e889ce7-965a-4de0-b096-60d4e743cf8b in Status: IN_PROGRESS for 2s [ 824.434198] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 755f030a-6e7c-43ec-adb9-cb4c270ad532 in Status: SUCCESS [ 824.434456] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.434704] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.434950] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.435270] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.435443] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.435499] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.435657] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.435779] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.435897] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.436116] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('755f030a-6e7c-43ec-adb9-cb4c270ad532',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.772386] env[65337]: INFO networking_nsxv3.common.synchronization [req-efc86617-f363-4315-85ff-9c723564b69c req-aac345e2-b4cc-4699-bc41-01c974f137c8 service nova] Enqueued Resource ID: 8e29edb7-88ed-486f-9fa2-5fb50a0857b5 with Priority: HIGHEST for action security_group_rules [ 824.772707] env[65337]: INFO networking_nsxv3.common.synchronization [req-efc86617-f363-4315-85ff-9c723564b69c req-aac345e2-b4cc-4699-bc41-01c974f137c8 service nova] Enqueued Resource ID: 8e29edb7-88ed-486f-9fa2-5fb50a0857b5 with Priority: HIGHEST for action security_group_members [ 824.772826] env[65337]: INFO networking_nsxv3.common.synchronization [req-efc86617-f363-4315-85ff-9c723564b69c req-aac345e2-b4cc-4699-bc41-01c974f137c8 service nova] Enqueued Resource ID: 3e993003-61be-49f7-bbf4-1203691ee1ab with Priority: HIGHEST for action port [ 824.775499] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e29edb7-88ed-486f-9fa2-5fb50a0857b5 with Priority: HIGHEST for action security_group_rules [ 824.775499] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e29edb7-88ed-486f-9fa2-5fb50a0857b5 with Priority: HIGHEST for action security_group_members [ 824.775499] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e993003-61be-49f7-bbf4-1203691ee1ab with Priority: HIGHEST for action port [ 824.775499] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8e29edb7-88ed-486f-9fa2-5fb50a0857b5 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.775499] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8e29edb7-88ed-486f-9fa2-5fb50a0857b5" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.775499] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8e29edb7-88ed-486f-9fa2-5fb50a0857b5" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.775499] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8e29edb7-88ed-486f-9fa2-5fb50a0857b5" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.775499] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8e29edb7-88ed-486f-9fa2-5fb50a0857b5',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.777455] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e29edb7-88ed-486f-9fa2-5fb50a0857b5 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.778018] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e29edb7-88ed-486f-9fa2-5fb50a0857b5" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.778018] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e29edb7-88ed-486f-9fa2-5fb50a0857b5" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.778145] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e29edb7-88ed-486f-9fa2-5fb50a0857b5" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.778394] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.778529] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.778589] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.779160] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.779160] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.779585] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8e29edb7-88ed-486f-9fa2-5fb50a0857b5',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.780769] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-3e993003-61be-49f7-bbf4-1203691ee1ab taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.780939] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3e993003-61be-49f7-bbf4-1203691ee1ab" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.780939] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3e993003-61be-49f7-bbf4-1203691ee1ab" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.781148] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3e993003-61be-49f7-bbf4-1203691ee1ab" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.781217] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e993003-61be-49f7-bbf4-1203691ee1ab',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.939129] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-755f030a-6e7c-43ec-adb9-cb4c270ad532 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.939266] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.939334] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.939568] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.939731] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.939831] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.939891] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.940046] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.940129] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.940212] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.940353] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-755f030a-6e7c-43ec-adb9-cb4c270ad532 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.940438] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.940495] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.940774] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.940915] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.941013] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.941077] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.941215] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.941289] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.941367] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.941452] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('755f030a-6e7c-43ec-adb9-cb4c270ad532',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.944945] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85232c6c-cd42-4a15-9924-943a4e75a091 in Status: SUCCESS [ 824.946076] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85232c6c-cd42-4a15-9924-943a4e75a091" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.286527] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8e29edb7-88ed-486f-9fa2-5fb50a0857b5',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.287523] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e29edb7-88ed-486f-9fa2-5fb50a0857b5 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.287655] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e29edb7-88ed-486f-9fa2-5fb50a0857b5" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.287785] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3e993003-61be-49f7-bbf4-1203691ee1ab with status ACTIVE [ 825.287936] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.288050] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.288116] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.288315] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.288399] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.288563] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.288658] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.288717] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.288858] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.289172] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.289246] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.289323] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.289380] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.290899] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.291011] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.291123] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3e993003-61be-49f7-bbf4-1203691ee1ab is going to be updated. [ 825.340879] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.340879] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.340879] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.341315] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.341422] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.341552] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3e993003-61be-49f7-bbf4-1203691ee1ab" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.445062] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 755f030a-6e7c-43ec-adb9-cb4c270ad532: rpc.has_security_group_logging(os_id): False [ 825.463663] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.463854] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.463909] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.464125] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.490899] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.491193] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.491425] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.491425] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.491585] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.491668] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.491865] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.491964] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.492038] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.492186] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.492258] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.492457] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.492554] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.492617] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.492755] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.492864] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.492906] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 755f030a-6e7c-43ec-adb9-cb4c270ad532 is going to be updated. [ 825.559411] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.559499] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.560153] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.560153] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.560153] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.574906] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 755f030a-6e7c-43ec-adb9-cb4c270ad532 in Status: IN_PROGRESS for 2s [ 825.648381] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4fe2934b-ab8b-4bda-9010-1a9725b2c40c in Status: SUCCESS [ 825.649161] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4fe2934b-ab8b-4bda-9010-1a9725b2c40c deletion is rescheduled due to dependency. [ 825.649161] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fe2934b-ab8b-4bda-9010-1a9725b2c40c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.793620] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8e29edb7-88ed-486f-9fa2-5fb50a0857b5',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.922784] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d4ff60fe-3407-42aa-b33c-6254779ad495 in Status: SUCCESS [ 825.923099] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d4ff60fe-3407-42aa-b33c-6254779ad495" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.923886] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d8e2d833-6da9-488a-a2b1-f410f4205706 in Status: SUCCESS [ 825.924069] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d8e2d833-6da9-488a-a2b1-f410f4205706" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.965564] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24 in Status: SUCCESS [ 825.965851] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.004046] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d9afc808-3692-46b5-a84b-018d8d2b7f94 in Status: SUCCESS [ 826.004283] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d9afc808-3692-46b5-a84b-018d8d2b7f94" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.260374] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d in Status: SUCCESS [ 826.260587] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d deletion is rescheduled due to dependency. [ 826.260717] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.299042] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.299323] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.299466] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.299750] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.299906] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.300170] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8e29edb7-88ed-486f-9fa2-5fb50a0857b5 is going to be created. [ 826.327598] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9e889ce7-965a-4de0-b096-60d4e743cf8b in Status: SUCCESS [ 826.327790] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.337399] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.337550] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.337622] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.337829] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.338043] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.349486] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e29edb7-88ed-486f-9fa2-5fb50a0857b5 in Status: UNINITIALIZED for 2s [ 827.094413] env[65337]: INFO networking_nsxv3.common.synchronization [None req-ca34a2e7-c229-4eb3-b2cb-63fe08f933cf tempest-AttachInterfacesTestJSON-1783062477 tempest-AttachInterfacesTestJSON-1783062477-project-member] Enqueued Resource ID: d72090eb-ca70-4a65-8186-a5f4b40ed4cd with Priority: HIGHEST for action security_group_rules [ 827.094413] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d72090eb-ca70-4a65-8186-a5f4b40ed4cd with Priority: HIGHEST for action security_group_rules [ 827.094743] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d72090eb-ca70-4a65-8186-a5f4b40ed4cd taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.095037] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d72090eb-ca70-4a65-8186-a5f4b40ed4cd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.095037] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d72090eb-ca70-4a65-8186-a5f4b40ed4cd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.095392] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d72090eb-ca70-4a65-8186-a5f4b40ed4cd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.095520] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d72090eb-ca70-4a65-8186-a5f4b40ed4cd',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.227472] env[65337]: INFO networking_nsxv3.common.synchronization [None req-70bc2fcd-002d-483d-811a-f6651e9cb3e5 tempest-AttachInterfacesTestJSON-1783062477 tempest-AttachInterfacesTestJSON-1783062477-project-member] Enqueued Resource ID: d72090eb-ca70-4a65-8186-a5f4b40ed4cd with Priority: HIGHEST for action security_group_rules [ 827.227857] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d72090eb-ca70-4a65-8186-a5f4b40ed4cd with Priority: HIGHEST for action security_group_rules [ 827.228244] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d72090eb-ca70-4a65-8186-a5f4b40ed4cd taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.228478] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d72090eb-ca70-4a65-8186-a5f4b40ed4cd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.591854] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 755f030a-6e7c-43ec-adb9-cb4c270ad532 in Status: SUCCESS [ 827.592084] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.592260] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.592508] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.592599] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('755f030a-6e7c-43ec-adb9-cb4c270ad532',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.617226] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.617398] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.617453] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.617628] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.617714] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.617812] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d72090eb-ca70-4a65-8186-a5f4b40ed4cd already deleted. [ 827.617896] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d72090eb-ca70-4a65-8186-a5f4b40ed4cd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.618042] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d72090eb-ca70-4a65-8186-a5f4b40ed4cd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.618199] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d72090eb-ca70-4a65-8186-a5f4b40ed4cd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.618280] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d72090eb-ca70-4a65-8186-a5f4b40ed4cd',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.095110] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-755f030a-6e7c-43ec-adb9-cb4c270ad532 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.095422] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.095422] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.095670] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.095670] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.095849] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.095849] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.095982] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.096082] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.096290] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.096390] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('755f030a-6e7c-43ec-adb9-cb4c270ad532',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.140714] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.140857] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.140901] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.141134] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.141348] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.141348] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d72090eb-ca70-4a65-8186-a5f4b40ed4cd already deleted. [ 828.141417] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d72090eb-ca70-4a65-8186-a5f4b40ed4cd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.187138] env[65337]: INFO networking_nsxv3.common.synchronization [req-32a63137-cc8b-45bb-b8bf-07279c66511d req-ade0c7a7-037e-4a9d-8ad1-e51b221c5cd7 tempest-ListImageFiltersTestJSON-525832378 tempest-ListImageFiltersTestJSON-525832378-project-member] Enqueued Resource ID: 2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24 with Priority: HIGHEST for action security_group_members [ 828.187672] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24 with Priority: HIGHEST for action security_group_members [ 828.188204] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.188445] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.188589] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.188814] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.189023] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.189160] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.189243] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.189460] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.189597] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.189665] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.365803] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e29edb7-88ed-486f-9fa2-5fb50a0857b5 in Status: SUCCESS [ 828.365993] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e29edb7-88ed-486f-9fa2-5fb50a0857b5" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.366292] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e29edb7-88ed-486f-9fa2-5fb50a0857b5" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.366551] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e29edb7-88ed-486f-9fa2-5fb50a0857b5" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.366777] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.366995] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.367115] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.367467] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.367467] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.367467] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e29edb7-88ed-486f-9fa2-5fb50a0857b5" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.367689] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8e29edb7-88ed-486f-9fa2-5fb50a0857b5',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.599258] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-755f030a-6e7c-43ec-adb9-cb4c270ad532 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.599408] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.599539] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.599776] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.599896] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.599969] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.600030] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.601161] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.601161] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.601161] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.601282] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-755f030a-6e7c-43ec-adb9-cb4c270ad532 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.601369] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.601429] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.601592] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.601749] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.602189] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.602189] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.602189] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.602189] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.602189] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.602411] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('755f030a-6e7c-43ec-adb9-cb4c270ad532',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.691919] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.692110] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.692182] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.692404] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.692516] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.692745] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.692851] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.692910] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.693083] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.693163] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.693251] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24 is going to be updated. [ 828.728330] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.728457] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.728564] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.728739] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.728962] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.740919] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24 in Status: IN_PROGRESS for 2s [ 828.870024] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e29edb7-88ed-486f-9fa2-5fb50a0857b5 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.870366] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e29edb7-88ed-486f-9fa2-5fb50a0857b5" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.870700] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e29edb7-88ed-486f-9fa2-5fb50a0857b5" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.870777] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e29edb7-88ed-486f-9fa2-5fb50a0857b5" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.871046] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.871222] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.871328] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.871570] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.871739] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.871867] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e29edb7-88ed-486f-9fa2-5fb50a0857b5" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.872127] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e29edb7-88ed-486f-9fa2-5fb50a0857b5 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.872285] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e29edb7-88ed-486f-9fa2-5fb50a0857b5" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.872390] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e29edb7-88ed-486f-9fa2-5fb50a0857b5" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.872603] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e29edb7-88ed-486f-9fa2-5fb50a0857b5" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.872845] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.873658] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.873658] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.873658] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.873658] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.875052] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e29edb7-88ed-486f-9fa2-5fb50a0857b5" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.875261] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8e29edb7-88ed-486f-9fa2-5fb50a0857b5',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.105888] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 755f030a-6e7c-43ec-adb9-cb4c270ad532: rpc.has_security_group_logging(os_id): False [ 829.134047] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.134047] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.134047] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.134047] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.134047] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.134047] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.134449] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.134449] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.134449] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.134449] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.134678] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.134874] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.134874] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.134976] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.135020] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.135218] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.135309] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.135361] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.135539] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.135615] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.136143] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 755f030a-6e7c-43ec-adb9-cb4c270ad532 is going to be updated. [ 829.203116] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.203327] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.203404] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.203635] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.203836] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.223347] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 755f030a-6e7c-43ec-adb9-cb4c270ad532 in Status: IN_PROGRESS for 2s [ 829.354635] env[65337]: INFO networking_nsxv3.common.synchronization [req-28d07970-285a-4dad-aaa3-d1acab758cd8 req-b8a2cdc0-334d-4944-a88f-58732be9f50f tempest-SecurityGroupsTestJSON-920822125 tempest-SecurityGroupsTestJSON-920822125-project-member] Enqueued Resource ID: cc860d7f-b6cd-4778-bbd7-a65ff0fc5bde with Priority: HIGHEST for action security_group_members [ 829.354635] env[65337]: INFO networking_nsxv3.common.synchronization [req-28d07970-285a-4dad-aaa3-d1acab758cd8 req-b8a2cdc0-334d-4944-a88f-58732be9f50f tempest-SecurityGroupsTestJSON-920822125 tempest-SecurityGroupsTestJSON-920822125-project-member] Enqueued Resource ID: 755f030a-6e7c-43ec-adb9-cb4c270ad532 with Priority: HIGHEST for action security_group_members [ 829.355588] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc860d7f-b6cd-4778-bbd7-a65ff0fc5bde with Priority: HIGHEST for action security_group_members [ 829.355744] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 755f030a-6e7c-43ec-adb9-cb4c270ad532 with Priority: HIGHEST for action security_group_members [ 829.356058] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc860d7f-b6cd-4778-bbd7-a65ff0fc5bde taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.356217] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc860d7f-b6cd-4778-bbd7-a65ff0fc5bde" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.356255] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc860d7f-b6cd-4778-bbd7-a65ff0fc5bde" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.356511] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc860d7f-b6cd-4778-bbd7-a65ff0fc5bde" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.356697] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.356837] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.356925] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.357289] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.357289] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.357289] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc860d7f-b6cd-4778-bbd7-a65ff0fc5bde',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.359114] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-755f030a-6e7c-43ec-adb9-cb4c270ad532 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.359114] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.359114] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.359114] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.359114] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.359114] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.359114] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.359654] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.359654] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.359654] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('755f030a-6e7c-43ec-adb9-cb4c270ad532',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.377927] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8e29edb7-88ed-486f-9fa2-5fb50a0857b5: rpc.has_security_group_logging(os_id): False [ 829.400209] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.400412] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.400412] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.400618] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.400729] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.401142] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.401142] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.401142] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.401395] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.401395] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.401590] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.401700] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.401776] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.401920] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.402042] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.402241] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.402338] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.402441] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.402655] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.402925] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.403051] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8e29edb7-88ed-486f-9fa2-5fb50a0857b5 is going to be created. [ 829.408643] env[65337]: INFO networking_nsxv3.common.synchronization [req-28d07970-285a-4dad-aaa3-d1acab758cd8 req-b8a2cdc0-334d-4944-a88f-58732be9f50f tempest-SecurityGroupsTestJSON-920822125 tempest-SecurityGroupsTestJSON-920822125-project-member] Enqueued Resource ID: 755f030a-6e7c-43ec-adb9-cb4c270ad532 with Priority: HIGHEST for action security_group_rules [ 829.408821] env[65337]: INFO networking_nsxv3.common.synchronization [req-28d07970-285a-4dad-aaa3-d1acab758cd8 req-b8a2cdc0-334d-4944-a88f-58732be9f50f tempest-SecurityGroupsTestJSON-920822125 tempest-SecurityGroupsTestJSON-920822125-project-member] Enqueued Resource ID: 755f030a-6e7c-43ec-adb9-cb4c270ad532 with Priority: HIGHEST for action security_group_members [ 829.408951] env[65337]: INFO networking_nsxv3.common.synchronization [req-28d07970-285a-4dad-aaa3-d1acab758cd8 req-b8a2cdc0-334d-4944-a88f-58732be9f50f tempest-SecurityGroupsTestJSON-920822125 tempest-SecurityGroupsTestJSON-920822125-project-member] Enqueued Resource ID: cc860d7f-b6cd-4778-bbd7-a65ff0fc5bde with Priority: HIGHEST for action security_group_rules [ 829.409097] env[65337]: INFO networking_nsxv3.common.synchronization [req-28d07970-285a-4dad-aaa3-d1acab758cd8 req-b8a2cdc0-334d-4944-a88f-58732be9f50f tempest-SecurityGroupsTestJSON-920822125 tempest-SecurityGroupsTestJSON-920822125-project-member] Enqueued Resource ID: cc860d7f-b6cd-4778-bbd7-a65ff0fc5bde with Priority: HIGHEST for action security_group_members [ 829.409224] env[65337]: INFO networking_nsxv3.common.synchronization [req-28d07970-285a-4dad-aaa3-d1acab758cd8 req-b8a2cdc0-334d-4944-a88f-58732be9f50f tempest-SecurityGroupsTestJSON-920822125 tempest-SecurityGroupsTestJSON-920822125-project-member] Enqueued Resource ID: b6d21eab-bc76-4c67-a3f0-6dc71ab10982 with Priority: HIGHEST for action port [ 829.409750] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 755f030a-6e7c-43ec-adb9-cb4c270ad532 with Priority: HIGHEST for action security_group_rules [ 829.409909] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc860d7f-b6cd-4778-bbd7-a65ff0fc5bde with Priority: HIGHEST for action security_group_rules [ 829.410138] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6d21eab-bc76-4c67-a3f0-6dc71ab10982 with Priority: HIGHEST for action port [ 829.410262] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 755f030a-6e7c-43ec-adb9-cb4c270ad532 with Priority: HIGHEST for action security_group_members [ 829.410355] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc860d7f-b6cd-4778-bbd7-a65ff0fc5bde with Priority: HIGHEST for action security_group_members [ 829.410642] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-755f030a-6e7c-43ec-adb9-cb4c270ad532 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.410778] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.411087] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cc860d7f-b6cd-4778-bbd7-a65ff0fc5bde taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.411233] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cc860d7f-b6cd-4778-bbd7-a65ff0fc5bde" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.411283] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cc860d7f-b6cd-4778-bbd7-a65ff0fc5bde" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.411636] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cc860d7f-b6cd-4778-bbd7-a65ff0fc5bde" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.411636] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cc860d7f-b6cd-4778-bbd7-a65ff0fc5bde',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.412692] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-b6d21eab-bc76-4c67-a3f0-6dc71ab10982 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.412839] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b6d21eab-bc76-4c67-a3f0-6dc71ab10982" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.412952] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b6d21eab-bc76-4c67-a3f0-6dc71ab10982" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.413112] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b6d21eab-bc76-4c67-a3f0-6dc71ab10982" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.413190] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b6d21eab-bc76-4c67-a3f0-6dc71ab10982',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.414515] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-755f030a-6e7c-43ec-adb9-cb4c270ad532 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.414712] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.414921] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc860d7f-b6cd-4778-bbd7-a65ff0fc5bde taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.415066] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc860d7f-b6cd-4778-bbd7-a65ff0fc5bde" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.478438] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.478764] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.478764] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.478968] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.479172] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.492170] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8e29edb7-88ed-486f-9fa2-5fb50a0857b5 in Status: IN_PROGRESS for 2s [ 829.693610] env[65337]: INFO networking_nsxv3.common.synchronization [req-b3475d25-3bc5-4e2c-bc00-d1b6bd83e9a8 req-f9677a04-1e83-4618-9916-08e08bee9dfe tempest-ServerExternalEventsTest-899198155 tempest-ServerExternalEventsTest-899198155-project-member] Enqueued Resource ID: 40a56e89-d484-4891-85a5-afa67f87b2d1 with Priority: HIGHEST for action security_group_members [ 829.694688] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40a56e89-d484-4891-85a5-afa67f87b2d1 with Priority: HIGHEST for action security_group_members [ 829.695048] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-40a56e89-d484-4891-85a5-afa67f87b2d1 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.695201] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40a56e89-d484-4891-85a5-afa67f87b2d1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.696120] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40a56e89-d484-4891-85a5-afa67f87b2d1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.696120] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40a56e89-d484-4891-85a5-afa67f87b2d1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.696120] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.696120] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.696120] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.696427] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.696948] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.697084] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('40a56e89-d484-4891-85a5-afa67f87b2d1',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.862112] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cc860d7f-b6cd-4778-bbd7-a65ff0fc5bde',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.863542] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('755f030a-6e7c-43ec-adb9-cb4c270ad532',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.916760] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc860d7f-b6cd-4778-bbd7-a65ff0fc5bde taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.917053] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc860d7f-b6cd-4778-bbd7-a65ff0fc5bde" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.919750] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b6d21eab-bc76-4c67-a3f0-6dc71ab10982 with status ACTIVE [ 829.919978] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.920182] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.920321] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.920597] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.920694] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.920991] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.921197] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.921298] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.921550] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.921702] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.922049] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.922192] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.922308] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.922693] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.922881] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.922979] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b6d21eab-bc76-4c67-a3f0-6dc71ab10982 is going to be updated. [ 829.960567] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.960732] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.960809] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.961040] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.961174] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.961492] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b6d21eab-bc76-4c67-a3f0-6dc71ab10982" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.096238] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock network-292 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.096520] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "network-292" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.096625] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "network-292" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.096881] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "network-292" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.097241] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.097419] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.097533] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.097761] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.097906] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.098135] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 830.098241] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 830.098344] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 830.098446] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 830.098551] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 830.098652] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 830.098778] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 830.117523] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 830.118033] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 830.118033] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 830.118033] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "network-292" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.118336] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock port-8bd18384-1098-4445-81d3-25b9df6b761e taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.118516] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "port-8bd18384-1098-4445-81d3-25b9df6b761e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.118635] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "port-8bd18384-1098-4445-81d3-25b9df6b761e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.118976] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "port-8bd18384-1098-4445-81d3-25b9df6b761e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.119128] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8bd18384-1098-4445-81d3-25b9df6b761e',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.200194] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.200194] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.200370] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.200455] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.200544] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.200741] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.200830] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.200899] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.201121] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.201208] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.201208] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40a56e89-d484-4891-85a5-afa67f87b2d1 already deleted. [ 830.201318] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40a56e89-d484-4891-85a5-afa67f87b2d1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.365799] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cc860d7f-b6cd-4778-bbd7-a65ff0fc5bde',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.367083] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('755f030a-6e7c-43ec-adb9-cb4c270ad532',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.622232] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.622649] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.623172] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.623609] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.623876] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.624138] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Segment Port 8bd18384-1098-4445-81d3-25b9df6b761e not found, creating... [ 830.624580] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.624823] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.625055] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.625404] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.625627] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.626093] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.626340] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.626610] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.626841] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.627259] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.627504] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Resource: SegmentPort with ID: 8bd18384-1098-4445-81d3-25b9df6b761e is going to be created. [ 830.649129] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.649499] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.649706] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.650133] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.650499] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.650860] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "port-8bd18384-1098-4445-81d3-25b9df6b761e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.752158] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24 in Status: SUCCESS [ 830.752380] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24 deletion is rescheduled due to dependency. [ 830.752535] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.869268] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.869438] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.869523] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.869795] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.869887] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.870053] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 755f030a-6e7c-43ec-adb9-cb4c270ad532 is going to be updated. [ 830.871506] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.871656] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.871764] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.871953] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.874849] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.875016] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc860d7f-b6cd-4778-bbd7-a65ff0fc5bde is going to be created. [ 830.901778] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.901952] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.902058] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.902304] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.902495] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.905412] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.905682] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.905682] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.905960] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.906224] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.915029] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 755f030a-6e7c-43ec-adb9-cb4c270ad532 in Status: IN_PROGRESS for 2s [ 830.915825] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc860d7f-b6cd-4778-bbd7-a65ff0fc5bde in Status: UNINITIALIZED for 2s [ 831.245268] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 755f030a-6e7c-43ec-adb9-cb4c270ad532 in Status: SUCCESS [ 831.245606] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.245756] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.245972] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.246074] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('755f030a-6e7c-43ec-adb9-cb4c270ad532',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.428053] env[65337]: INFO networking_nsxv3.common.synchronization [req-b3475d25-3bc5-4e2c-bc00-d1b6bd83e9a8 req-c9822ece-57a2-43f7-a5c8-3c9b7cdff83e service nova] Enqueued Resource ID: 40a56e89-d484-4891-85a5-afa67f87b2d1 with Priority: HIGHEST for action security_group_rules [ 831.428266] env[65337]: INFO networking_nsxv3.common.synchronization [req-b3475d25-3bc5-4e2c-bc00-d1b6bd83e9a8 req-c9822ece-57a2-43f7-a5c8-3c9b7cdff83e service nova] Enqueued Resource ID: 40a56e89-d484-4891-85a5-afa67f87b2d1 with Priority: HIGHEST for action security_group_members [ 831.428543] env[65337]: INFO networking_nsxv3.common.synchronization [req-b3475d25-3bc5-4e2c-bc00-d1b6bd83e9a8 req-c9822ece-57a2-43f7-a5c8-3c9b7cdff83e service nova] Enqueued Resource ID: 8bd18384-1098-4445-81d3-25b9df6b761e with Priority: HIGHEST for action port [ 831.429392] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40a56e89-d484-4891-85a5-afa67f87b2d1 with Priority: HIGHEST for action security_group_rules [ 831.429559] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40a56e89-d484-4891-85a5-afa67f87b2d1 with Priority: HIGHEST for action security_group_members [ 831.429657] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8bd18384-1098-4445-81d3-25b9df6b761e with Priority: HIGHEST for action port [ 831.430023] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-40a56e89-d484-4891-85a5-afa67f87b2d1 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.430154] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-40a56e89-d484-4891-85a5-afa67f87b2d1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.430300] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-40a56e89-d484-4891-85a5-afa67f87b2d1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.430713] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-40a56e89-d484-4891-85a5-afa67f87b2d1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.430779] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('40a56e89-d484-4891-85a5-afa67f87b2d1',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.431736] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-40a56e89-d484-4891-85a5-afa67f87b2d1 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.431854] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40a56e89-d484-4891-85a5-afa67f87b2d1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.431917] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40a56e89-d484-4891-85a5-afa67f87b2d1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.432116] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40a56e89-d484-4891-85a5-afa67f87b2d1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.432338] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.432417] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.432417] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.435997] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.435997] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.435997] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('40a56e89-d484-4891-85a5-afa67f87b2d1',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.438669] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-8bd18384-1098-4445-81d3-25b9df6b761e taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.438669] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8bd18384-1098-4445-81d3-25b9df6b761e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.438669] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8bd18384-1098-4445-81d3-25b9df6b761e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.438669] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8bd18384-1098-4445-81d3-25b9df6b761e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.438669] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8bd18384-1098-4445-81d3-25b9df6b761e',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.516135] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8e29edb7-88ed-486f-9fa2-5fb50a0857b5 in Status: SUCCESS [ 831.516135] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8e29edb7-88ed-486f-9fa2-5fb50a0857b5" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.750480] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-755f030a-6e7c-43ec-adb9-cb4c270ad532 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.750480] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.940419] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('40a56e89-d484-4891-85a5-afa67f87b2d1',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.941566] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-40a56e89-d484-4891-85a5-afa67f87b2d1 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.941694] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40a56e89-d484-4891-85a5-afa67f87b2d1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.942831] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8bd18384-1098-4445-81d3-25b9df6b761e with status ACTIVE [ 831.942831] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.942831] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.942831] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.942831] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.942831] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.942831] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.942831] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.942831] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.942831] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.943557] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.943557] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.943557] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.943557] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.943557] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.943557] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.943557] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8bd18384-1098-4445-81d3-25b9df6b761e is going to be updated. [ 831.967155] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.967155] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.967155] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.967155] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.967155] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.967155] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8bd18384-1098-4445-81d3-25b9df6b761e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.446244] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('40a56e89-d484-4891-85a5-afa67f87b2d1',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.926971] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc860d7f-b6cd-4778-bbd7-a65ff0fc5bde in Status: SUCCESS [ 832.927228] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc860d7f-b6cd-4778-bbd7-a65ff0fc5bde" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.927397] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc860d7f-b6cd-4778-bbd7-a65ff0fc5bde" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.927723] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc860d7f-b6cd-4778-bbd7-a65ff0fc5bde" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.927818] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.928073] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.928137] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.928314] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.928399] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.928497] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc860d7f-b6cd-4778-bbd7-a65ff0fc5bde',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.930593] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 755f030a-6e7c-43ec-adb9-cb4c270ad532 in Status: SUCCESS [ 832.930593] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.930593] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.930837] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.930890] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.930994] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.931067] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.931389] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.931475] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.932178] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('755f030a-6e7c-43ec-adb9-cb4c270ad532',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.949947] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.950116] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.950184] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.950387] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.950552] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.950651] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40a56e89-d484-4891-85a5-afa67f87b2d1 is going to be created. [ 832.974818] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.975011] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.975083] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.975305] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.975496] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.990372] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40a56e89-d484-4891-85a5-afa67f87b2d1 in Status: UNINITIALIZED for 2s [ 833.436418] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cc860d7f-b6cd-4778-bbd7-a65ff0fc5bde',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.437555] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('755f030a-6e7c-43ec-adb9-cb4c270ad532',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.941599] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cc860d7f-b6cd-4778-bbd7-a65ff0fc5bde',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.942622] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('755f030a-6e7c-43ec-adb9-cb4c270ad532',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.445057] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.445238] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.445381] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.445612] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.445753] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.445849] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc860d7f-b6cd-4778-bbd7-a65ff0fc5bde is going to be updated. [ 834.447718] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.447718] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.447718] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.448047] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.448047] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.448248] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 755f030a-6e7c-43ec-adb9-cb4c270ad532 is going to be updated. [ 834.485277] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.485378] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.486041] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.486041] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.486041] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.488060] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.488240] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.488355] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.488644] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.488877] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.502243] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc860d7f-b6cd-4778-bbd7-a65ff0fc5bde in Status: IN_PROGRESS for 2s [ 834.503226] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 755f030a-6e7c-43ec-adb9-cb4c270ad532 in Status: IN_PROGRESS for 2s [ 835.003081] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40a56e89-d484-4891-85a5-afa67f87b2d1 in Status: SUCCESS [ 835.003434] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40a56e89-d484-4891-85a5-afa67f87b2d1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.003593] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40a56e89-d484-4891-85a5-afa67f87b2d1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.003841] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40a56e89-d484-4891-85a5-afa67f87b2d1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.004118] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.004276] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.004359] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.004591] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.004704] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.005913] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40a56e89-d484-4891-85a5-afa67f87b2d1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.006071] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('40a56e89-d484-4891-85a5-afa67f87b2d1',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.508561] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-40a56e89-d484-4891-85a5-afa67f87b2d1 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.508811] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40a56e89-d484-4891-85a5-afa67f87b2d1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.508894] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40a56e89-d484-4891-85a5-afa67f87b2d1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.509371] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40a56e89-d484-4891-85a5-afa67f87b2d1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.509371] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.509627] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.509678] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.509983] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.510237] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.510327] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40a56e89-d484-4891-85a5-afa67f87b2d1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.510480] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-40a56e89-d484-4891-85a5-afa67f87b2d1 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.510611] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40a56e89-d484-4891-85a5-afa67f87b2d1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.510722] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40a56e89-d484-4891-85a5-afa67f87b2d1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.511314] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40a56e89-d484-4891-85a5-afa67f87b2d1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.511314] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.511437] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.511437] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.511585] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.511931] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.511931] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40a56e89-d484-4891-85a5-afa67f87b2d1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.511931] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('40a56e89-d484-4891-85a5-afa67f87b2d1',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.013886] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 40a56e89-d484-4891-85a5-afa67f87b2d1: rpc.has_security_group_logging(os_id): False [ 836.037112] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.037112] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.037112] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.037112] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.037112] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.037112] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.037112] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.037112] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.037112] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.037112] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.037112] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.037112] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.037112] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.037112] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.037112] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.037749] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.037749] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.037749] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.037749] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.037749] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.038569] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 40a56e89-d484-4891-85a5-afa67f87b2d1 is going to be created. [ 836.105245] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.105245] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.105245] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.105245] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.105245] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.115393] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 40a56e89-d484-4891-85a5-afa67f87b2d1 in Status: IN_PROGRESS for 2s [ 836.430201] env[65337]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 836.430313] env[65337]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=5 [ 836.517794] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 755f030a-6e7c-43ec-adb9-cb4c270ad532 in Status: SUCCESS [ 836.518245] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.518350] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.518591] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.520330] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.520330] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.520330] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.520330] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.520330] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.520330] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.521437] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('755f030a-6e7c-43ec-adb9-cb4c270ad532',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.523259] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc860d7f-b6cd-4778-bbd7-a65ff0fc5bde in Status: SUCCESS [ 836.523570] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc860d7f-b6cd-4778-bbd7-a65ff0fc5bde" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.523773] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc860d7f-b6cd-4778-bbd7-a65ff0fc5bde" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.524018] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc860d7f-b6cd-4778-bbd7-a65ff0fc5bde" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.527743] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.527829] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.527887] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.528182] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.528290] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.529049] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc860d7f-b6cd-4778-bbd7-a65ff0fc5bde" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.529049] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cc860d7f-b6cd-4778-bbd7-a65ff0fc5bde',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.030708] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-755f030a-6e7c-43ec-adb9-cb4c270ad532 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.030945] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.031935] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.031935] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.032091] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.032179] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.032247] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.032848] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.032848] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.032848] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.033410] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-755f030a-6e7c-43ec-adb9-cb4c270ad532 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.033594] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.033594] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.033713] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.033883] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.034014] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.034147] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.034310] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.034401] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.034488] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.035088] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('755f030a-6e7c-43ec-adb9-cb4c270ad532',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.036086] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cc860d7f-b6cd-4778-bbd7-a65ff0fc5bde',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.200202] env[65337]: INFO networking_nsxv3.common.synchronization [req-4d3f57d8-b8cb-48c2-8238-dbb0d84e8add req-85bec5f9-c730-40b8-b7a9-273a0b5016dd tempest-SecurityGroupsTestJSON-920822125 tempest-SecurityGroupsTestJSON-920822125-project-member] Enqueued Resource ID: cc860d7f-b6cd-4778-bbd7-a65ff0fc5bde with Priority: HIGHEST for action security_group_members [ 837.200617] env[65337]: INFO networking_nsxv3.common.synchronization [req-4d3f57d8-b8cb-48c2-8238-dbb0d84e8add req-85bec5f9-c730-40b8-b7a9-273a0b5016dd tempest-SecurityGroupsTestJSON-920822125 tempest-SecurityGroupsTestJSON-920822125-project-member] Enqueued Resource ID: 231402d3-be76-4b4e-89eb-6d9b3908b60e with Priority: HIGHEST for action security_group_members [ 837.200812] env[65337]: INFO networking_nsxv3.common.synchronization [req-4d3f57d8-b8cb-48c2-8238-dbb0d84e8add req-85bec5f9-c730-40b8-b7a9-273a0b5016dd tempest-SecurityGroupsTestJSON-920822125 tempest-SecurityGroupsTestJSON-920822125-project-member] Enqueued Resource ID: 755f030a-6e7c-43ec-adb9-cb4c270ad532 with Priority: HIGHEST for action security_group_members [ 837.201772] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc860d7f-b6cd-4778-bbd7-a65ff0fc5bde with Priority: HIGHEST for action security_group_members [ 837.201961] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 231402d3-be76-4b4e-89eb-6d9b3908b60e with Priority: HIGHEST for action security_group_members [ 837.202081] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 755f030a-6e7c-43ec-adb9-cb4c270ad532 with Priority: HIGHEST for action security_group_members [ 837.202408] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc860d7f-b6cd-4778-bbd7-a65ff0fc5bde taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.202601] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc860d7f-b6cd-4778-bbd7-a65ff0fc5bde" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.202648] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc860d7f-b6cd-4778-bbd7-a65ff0fc5bde" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.203449] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc860d7f-b6cd-4778-bbd7-a65ff0fc5bde" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.203449] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.203449] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.203449] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.203449] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.203449] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.203449] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc860d7f-b6cd-4778-bbd7-a65ff0fc5bde',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.204454] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-231402d3-be76-4b4e-89eb-6d9b3908b60e taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.204574] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-231402d3-be76-4b4e-89eb-6d9b3908b60e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.204626] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-231402d3-be76-4b4e-89eb-6d9b3908b60e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.205504] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-231402d3-be76-4b4e-89eb-6d9b3908b60e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.205504] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.205504] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.205504] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.205504] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.205504] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.205784] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('231402d3-be76-4b4e-89eb-6d9b3908b60e',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.207172] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-755f030a-6e7c-43ec-adb9-cb4c270ad532 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.207172] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.207172] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.207172] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.207172] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.207172] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.207172] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.207501] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.207501] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.207501] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('755f030a-6e7c-43ec-adb9-cb4c270ad532',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.253775] env[65337]: INFO networking_nsxv3.common.synchronization [req-4d3f57d8-b8cb-48c2-8238-dbb0d84e8add req-85bec5f9-c730-40b8-b7a9-273a0b5016dd tempest-SecurityGroupsTestJSON-920822125 tempest-SecurityGroupsTestJSON-920822125-project-member] Enqueued Resource ID: 231402d3-be76-4b4e-89eb-6d9b3908b60e with Priority: HIGHEST for action security_group_rules [ 837.253958] env[65337]: INFO networking_nsxv3.common.synchronization [req-4d3f57d8-b8cb-48c2-8238-dbb0d84e8add req-85bec5f9-c730-40b8-b7a9-273a0b5016dd tempest-SecurityGroupsTestJSON-920822125 tempest-SecurityGroupsTestJSON-920822125-project-member] Enqueued Resource ID: 231402d3-be76-4b4e-89eb-6d9b3908b60e with Priority: HIGHEST for action security_group_members [ 837.254106] env[65337]: INFO networking_nsxv3.common.synchronization [req-4d3f57d8-b8cb-48c2-8238-dbb0d84e8add req-85bec5f9-c730-40b8-b7a9-273a0b5016dd tempest-SecurityGroupsTestJSON-920822125 tempest-SecurityGroupsTestJSON-920822125-project-member] Enqueued Resource ID: 755f030a-6e7c-43ec-adb9-cb4c270ad532 with Priority: HIGHEST for action security_group_rules [ 837.254232] env[65337]: INFO networking_nsxv3.common.synchronization [req-4d3f57d8-b8cb-48c2-8238-dbb0d84e8add req-85bec5f9-c730-40b8-b7a9-273a0b5016dd tempest-SecurityGroupsTestJSON-920822125 tempest-SecurityGroupsTestJSON-920822125-project-member] Enqueued Resource ID: 755f030a-6e7c-43ec-adb9-cb4c270ad532 with Priority: HIGHEST for action security_group_members [ 837.254351] env[65337]: INFO networking_nsxv3.common.synchronization [req-4d3f57d8-b8cb-48c2-8238-dbb0d84e8add req-85bec5f9-c730-40b8-b7a9-273a0b5016dd tempest-SecurityGroupsTestJSON-920822125 tempest-SecurityGroupsTestJSON-920822125-project-member] Enqueued Resource ID: cc860d7f-b6cd-4778-bbd7-a65ff0fc5bde with Priority: HIGHEST for action security_group_rules [ 837.254469] env[65337]: INFO networking_nsxv3.common.synchronization [req-4d3f57d8-b8cb-48c2-8238-dbb0d84e8add req-85bec5f9-c730-40b8-b7a9-273a0b5016dd tempest-SecurityGroupsTestJSON-920822125 tempest-SecurityGroupsTestJSON-920822125-project-member] Enqueued Resource ID: cc860d7f-b6cd-4778-bbd7-a65ff0fc5bde with Priority: HIGHEST for action security_group_members [ 837.254697] env[65337]: INFO networking_nsxv3.common.synchronization [req-4d3f57d8-b8cb-48c2-8238-dbb0d84e8add req-85bec5f9-c730-40b8-b7a9-273a0b5016dd tempest-SecurityGroupsTestJSON-920822125 tempest-SecurityGroupsTestJSON-920822125-project-member] Enqueued Resource ID: b6d21eab-bc76-4c67-a3f0-6dc71ab10982 with Priority: HIGHEST for action port [ 837.255204] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 231402d3-be76-4b4e-89eb-6d9b3908b60e with Priority: HIGHEST for action security_group_rules [ 837.255352] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 755f030a-6e7c-43ec-adb9-cb4c270ad532 with Priority: HIGHEST for action security_group_rules [ 837.255490] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc860d7f-b6cd-4778-bbd7-a65ff0fc5bde with Priority: HIGHEST for action security_group_members [ 837.255535] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6d21eab-bc76-4c67-a3f0-6dc71ab10982 with Priority: HIGHEST for action port [ 837.255613] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc860d7f-b6cd-4778-bbd7-a65ff0fc5bde with Priority: HIGHEST for action security_group_rules [ 837.255696] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 231402d3-be76-4b4e-89eb-6d9b3908b60e with Priority: HIGHEST for action security_group_members [ 837.255825] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 755f030a-6e7c-43ec-adb9-cb4c270ad532 with Priority: HIGHEST for action security_group_members [ 837.256109] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-231402d3-be76-4b4e-89eb-6d9b3908b60e taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.256230] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-231402d3-be76-4b4e-89eb-6d9b3908b60e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.256316] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-231402d3-be76-4b4e-89eb-6d9b3908b60e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.256563] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-231402d3-be76-4b4e-89eb-6d9b3908b60e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.256640] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('231402d3-be76-4b4e-89eb-6d9b3908b60e',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.257517] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-755f030a-6e7c-43ec-adb9-cb4c270ad532 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.257611] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.257839] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc860d7f-b6cd-4778-bbd7-a65ff0fc5bde taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.257896] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc860d7f-b6cd-4778-bbd7-a65ff0fc5bde" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.259037] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-b6d21eab-bc76-4c67-a3f0-6dc71ab10982 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.259037] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b6d21eab-bc76-4c67-a3f0-6dc71ab10982" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.259037] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b6d21eab-bc76-4c67-a3f0-6dc71ab10982" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.259037] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b6d21eab-bc76-4c67-a3f0-6dc71ab10982" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.259037] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b6d21eab-bc76-4c67-a3f0-6dc71ab10982',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.259487] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cc860d7f-b6cd-4778-bbd7-a65ff0fc5bde taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.259487] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cc860d7f-b6cd-4778-bbd7-a65ff0fc5bde" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.259487] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-231402d3-be76-4b4e-89eb-6d9b3908b60e taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.259608] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-231402d3-be76-4b4e-89eb-6d9b3908b60e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.260547] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-755f030a-6e7c-43ec-adb9-cb4c270ad532 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.260547] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.538801] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cc860d7f-b6cd-4778-bbd7-a65ff0fc5bde: rpc.has_security_group_logging(os_id): False [ 837.540272] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 755f030a-6e7c-43ec-adb9-cb4c270ad532: rpc.has_security_group_logging(os_id): False [ 837.560526] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.560751] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.560824] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.561443] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.561443] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.561443] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.561663] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.561663] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.561798] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.561853] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.562466] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.562466] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.562466] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.562466] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.562466] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.563172] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.563172] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.563172] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.563172] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.563172] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.563172] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 755f030a-6e7c-43ec-adb9-cb4c270ad532 is going to be updated. [ 837.565546] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.565546] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.566859] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.566859] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.566859] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.567541] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.567541] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.567541] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.567755] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.567755] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.567755] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cc860d7f-b6cd-4778-bbd7-a65ff0fc5bde is going to be created. [ 837.632366] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.632507] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.632592] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.632943] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.633148] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.648009] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc860d7f-b6cd-4778-bbd7-a65ff0fc5bde in Status: IN_PROGRESS for 2s [ 837.656223] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.656223] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.656223] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.656223] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.656223] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.675398] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 755f030a-6e7c-43ec-adb9-cb4c270ad532 in Status: IN_PROGRESS for 2s [ 837.709383] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cc860d7f-b6cd-4778-bbd7-a65ff0fc5bde',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.711034] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('231402d3-be76-4b4e-89eb-6d9b3908b60e',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.711264] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('755f030a-6e7c-43ec-adb9-cb4c270ad532',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.763067] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-231402d3-be76-4b4e-89eb-6d9b3908b60e taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.763067] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-231402d3-be76-4b4e-89eb-6d9b3908b60e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.763067] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b6d21eab-bc76-4c67-a3f0-6dc71ab10982 with status ACTIVE [ 837.763067] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.763067] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.763067] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.763067] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.763067] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.763067] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.763067] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.763759] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.765068] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.765068] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.765068] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.765068] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.765068] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.765068] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.765068] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.765068] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b6d21eab-bc76-4c67-a3f0-6dc71ab10982 is going to be updated. [ 837.805572] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.805927] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.805927] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.806204] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.806387] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.806570] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b6d21eab-bc76-4c67-a3f0-6dc71ab10982" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.956984] env[65337]: INFO networking_nsxv3.common.synchronization [req-d5dcd084-122e-4c4e-9221-fb58a1cc8782 req-0d28ab6f-6048-4139-8a8a-a4cfa712ac55 tempest-InstanceActionsNegativeTestJSON-1572947405 tempest-InstanceActionsNegativeTestJSON-1572947405-project-member] Enqueued Resource ID: 8e29edb7-88ed-486f-9fa2-5fb50a0857b5 with Priority: HIGHEST for action security_group_members [ 837.956984] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e29edb7-88ed-486f-9fa2-5fb50a0857b5 with Priority: HIGHEST for action security_group_members [ 837.956984] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e29edb7-88ed-486f-9fa2-5fb50a0857b5 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.956984] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e29edb7-88ed-486f-9fa2-5fb50a0857b5" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.956984] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e29edb7-88ed-486f-9fa2-5fb50a0857b5" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.957387] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e29edb7-88ed-486f-9fa2-5fb50a0857b5" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.957387] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.957387] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.957519] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.957574] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.957663] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.957802] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8e29edb7-88ed-486f-9fa2-5fb50a0857b5',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.128187] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 40a56e89-d484-4891-85a5-afa67f87b2d1 in Status: SUCCESS [ 838.128409] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-40a56e89-d484-4891-85a5-afa67f87b2d1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.213961] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cc860d7f-b6cd-4778-bbd7-a65ff0fc5bde',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.217566] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('755f030a-6e7c-43ec-adb9-cb4c270ad532',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.217834] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('231402d3-be76-4b4e-89eb-6d9b3908b60e',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.461017] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.461201] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.461358] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.461630] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.461762] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.461969] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.462114] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.462211] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.462407] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.462488] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.462594] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8e29edb7-88ed-486f-9fa2-5fb50a0857b5 is going to be updated. [ 838.496277] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.496277] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.496277] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.496277] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.496277] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.507364] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e29edb7-88ed-486f-9fa2-5fb50a0857b5 in Status: IN_PROGRESS for 2s [ 838.723446] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.723733] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.723837] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.724117] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.724228] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.725497] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc860d7f-b6cd-4778-bbd7-a65ff0fc5bde is going to be updated. [ 838.728086] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.728086] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.728086] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.728086] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.728086] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.728086] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 755f030a-6e7c-43ec-adb9-cb4c270ad532 is going to be updated. [ 838.728086] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.728086] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.728086] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.728086] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.728086] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.728086] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 231402d3-be76-4b4e-89eb-6d9b3908b60e is going to be created. [ 838.758041] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.758041] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.758041] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.758419] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.758644] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.778762] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.779016] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.779257] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.779431] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.779604] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.781431] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.781542] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.781609] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.781780] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.781904] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.792415] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 231402d3-be76-4b4e-89eb-6d9b3908b60e in Status: UNINITIALIZED for 2s [ 838.793518] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 755f030a-6e7c-43ec-adb9-cb4c270ad532 in Status: IN_PROGRESS for 2s [ 838.794165] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc860d7f-b6cd-4778-bbd7-a65ff0fc5bde in Status: IN_PROGRESS for 2s [ 839.665531] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc860d7f-b6cd-4778-bbd7-a65ff0fc5bde in Status: SUCCESS [ 839.665928] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cc860d7f-b6cd-4778-bbd7-a65ff0fc5bde" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.665978] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cc860d7f-b6cd-4778-bbd7-a65ff0fc5bde" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.666176] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cc860d7f-b6cd-4778-bbd7-a65ff0fc5bde" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.666265] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cc860d7f-b6cd-4778-bbd7-a65ff0fc5bde',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.691817] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 755f030a-6e7c-43ec-adb9-cb4c270ad532 in Status: SUCCESS [ 839.692073] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.692381] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.692458] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.692542] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('755f030a-6e7c-43ec-adb9-cb4c270ad532',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.943174] env[65337]: INFO networking_nsxv3.common.synchronization [req-c0dbb20b-9fa5-462d-b430-b72ce6913c6b req-69614879-9d89-40d8-9e22-6ca7c7798a6c tempest-ServerGroupTestJSON-123689168 tempest-ServerGroupTestJSON-123689168-project-member] Enqueued Resource ID: 34a3f5b1-e642-4184-95f7-7ad20ed36f5b with Priority: HIGHEST for action security_group_members [ 839.943174] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34a3f5b1-e642-4184-95f7-7ad20ed36f5b with Priority: HIGHEST for action security_group_members [ 839.944180] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-34a3f5b1-e642-4184-95f7-7ad20ed36f5b taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.944180] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34a3f5b1-e642-4184-95f7-7ad20ed36f5b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.944180] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34a3f5b1-e642-4184-95f7-7ad20ed36f5b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.944743] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34a3f5b1-e642-4184-95f7-7ad20ed36f5b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.945208] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.945208] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.945208] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.945481] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.945812] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.945991] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('34a3f5b1-e642-4184-95f7-7ad20ed36f5b',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.168542] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc860d7f-b6cd-4778-bbd7-a65ff0fc5bde taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.168919] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc860d7f-b6cd-4778-bbd7-a65ff0fc5bde" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.195533] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-755f030a-6e7c-43ec-adb9-cb4c270ad532 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.195634] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.304383] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock network-546 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.305345] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "network-546" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.305632] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "network-546" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.306043] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "network-546" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.306354] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.306531] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.306655] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.306971] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.307139] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.307359] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 840.307469] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 840.307575] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 840.307680] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 840.307788] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 840.307897] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 840.308084] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 840.329308] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 840.329534] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 840.329754] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 840.329991] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "network-546" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.330659] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock port-9cfeb1d5-55e3-4fde-b744-60187f038153 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.330872] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "port-9cfeb1d5-55e3-4fde-b744-60187f038153" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.331043] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "port-9cfeb1d5-55e3-4fde-b744-60187f038153" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.331452] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "port-9cfeb1d5-55e3-4fde-b744-60187f038153" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.331644] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9cfeb1d5-55e3-4fde-b744-60187f038153',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.448475] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.448636] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.448708] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.448910] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.448998] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.449232] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.449335] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.449423] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.449666] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.449810] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.449906] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34a3f5b1-e642-4184-95f7-7ad20ed36f5b already deleted. [ 840.449994] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34a3f5b1-e642-4184-95f7-7ad20ed36f5b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.524923] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e29edb7-88ed-486f-9fa2-5fb50a0857b5 in Status: SUCCESS [ 840.525156] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8e29edb7-88ed-486f-9fa2-5fb50a0857b5 deletion is rescheduled due to dependency. [ 840.525296] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e29edb7-88ed-486f-9fa2-5fb50a0857b5" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.808266] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 755f030a-6e7c-43ec-adb9-cb4c270ad532 in Status: SUCCESS [ 840.808266] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.808759] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc860d7f-b6cd-4778-bbd7-a65ff0fc5bde in Status: SUCCESS [ 840.809036] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc860d7f-b6cd-4778-bbd7-a65ff0fc5bde" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.809244] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.809469] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.809724] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.809849] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.809913] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.810180] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.810258] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.810357] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('755f030a-6e7c-43ec-adb9-cb4c270ad532',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.811228] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc860d7f-b6cd-4778-bbd7-a65ff0fc5bde" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.811433] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc860d7f-b6cd-4778-bbd7-a65ff0fc5bde" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.812126] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.812126] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.812126] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.812126] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.812126] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.812511] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc860d7f-b6cd-4778-bbd7-a65ff0fc5bde',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.814429] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 231402d3-be76-4b4e-89eb-6d9b3908b60e in Status: SUCCESS [ 840.814429] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-231402d3-be76-4b4e-89eb-6d9b3908b60e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.815095] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-231402d3-be76-4b4e-89eb-6d9b3908b60e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.815095] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-231402d3-be76-4b4e-89eb-6d9b3908b60e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.815095] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.815254] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.815254] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.815550] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.815550] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.815757] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('231402d3-be76-4b4e-89eb-6d9b3908b60e',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.835364] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.835739] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.835902] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.836313] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.836502] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.836670] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Segment Port 9cfeb1d5-55e3-4fde-b744-60187f038153 not found, creating... [ 840.837135] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.837345] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.837554] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.837879] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.838502] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.838502] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.838739] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.838904] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.839215] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.839423] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.839619] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Resource: SegmentPort with ID: 9cfeb1d5-55e3-4fde-b744-60187f038153 is going to be created. [ 840.867210] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.867542] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.867667] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.867942] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.868194] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.868421] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "port-9cfeb1d5-55e3-4fde-b744-60187f038153" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.269580] env[65337]: INFO networking_nsxv3.common.synchronization [req-28dc137b-ae91-4a9c-9405-ae49e163df4e req-5b8dd409-6f0c-4a11-b4d3-d045e425dcaa tempest-SecurityGroupsTestJSON-920822125 tempest-SecurityGroupsTestJSON-920822125-project-member] Enqueued Resource ID: cc860d7f-b6cd-4778-bbd7-a65ff0fc5bde with Priority: HIGHEST for action security_group_members [ 841.269757] env[65337]: INFO networking_nsxv3.common.synchronization [req-28dc137b-ae91-4a9c-9405-ae49e163df4e req-5b8dd409-6f0c-4a11-b4d3-d045e425dcaa tempest-SecurityGroupsTestJSON-920822125 tempest-SecurityGroupsTestJSON-920822125-project-member] Enqueued Resource ID: 231402d3-be76-4b4e-89eb-6d9b3908b60e with Priority: HIGHEST for action security_group_members [ 841.269882] env[65337]: INFO networking_nsxv3.common.synchronization [req-28dc137b-ae91-4a9c-9405-ae49e163df4e req-5b8dd409-6f0c-4a11-b4d3-d045e425dcaa tempest-SecurityGroupsTestJSON-920822125 tempest-SecurityGroupsTestJSON-920822125-project-member] Enqueued Resource ID: 755f030a-6e7c-43ec-adb9-cb4c270ad532 with Priority: HIGHEST for action security_group_members [ 841.270418] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc860d7f-b6cd-4778-bbd7-a65ff0fc5bde with Priority: HIGHEST for action security_group_members [ 841.270591] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 231402d3-be76-4b4e-89eb-6d9b3908b60e with Priority: HIGHEST for action security_group_members [ 841.270679] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 755f030a-6e7c-43ec-adb9-cb4c270ad532 with Priority: HIGHEST for action security_group_members [ 841.271016] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc860d7f-b6cd-4778-bbd7-a65ff0fc5bde taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.271104] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc860d7f-b6cd-4778-bbd7-a65ff0fc5bde" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.271246] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-231402d3-be76-4b4e-89eb-6d9b3908b60e taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.271328] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-231402d3-be76-4b4e-89eb-6d9b3908b60e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.271508] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-755f030a-6e7c-43ec-adb9-cb4c270ad532 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.271588] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.315148] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('755f030a-6e7c-43ec-adb9-cb4c270ad532',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.317638] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cc860d7f-b6cd-4778-bbd7-a65ff0fc5bde',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.321268] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('231402d3-be76-4b4e-89eb-6d9b3908b60e',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.577449] env[65337]: INFO networking_nsxv3.common.synchronization [req-c0dbb20b-9fa5-462d-b430-b72ce6913c6b req-0302bcea-2ce2-407b-adf5-721f2e7ee6e9 service nova] Enqueued Resource ID: 34a3f5b1-e642-4184-95f7-7ad20ed36f5b with Priority: HIGHEST for action security_group_rules [ 841.577630] env[65337]: INFO networking_nsxv3.common.synchronization [req-c0dbb20b-9fa5-462d-b430-b72ce6913c6b req-0302bcea-2ce2-407b-adf5-721f2e7ee6e9 service nova] Enqueued Resource ID: 34a3f5b1-e642-4184-95f7-7ad20ed36f5b with Priority: HIGHEST for action security_group_members [ 841.577766] env[65337]: INFO networking_nsxv3.common.synchronization [req-c0dbb20b-9fa5-462d-b430-b72ce6913c6b req-0302bcea-2ce2-407b-adf5-721f2e7ee6e9 service nova] Enqueued Resource ID: 9cfeb1d5-55e3-4fde-b744-60187f038153 with Priority: HIGHEST for action port [ 841.578709] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34a3f5b1-e642-4184-95f7-7ad20ed36f5b with Priority: HIGHEST for action security_group_rules [ 841.578844] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34a3f5b1-e642-4184-95f7-7ad20ed36f5b with Priority: HIGHEST for action security_group_members [ 841.578939] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cfeb1d5-55e3-4fde-b744-60187f038153 with Priority: HIGHEST for action port [ 841.579343] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-34a3f5b1-e642-4184-95f7-7ad20ed36f5b taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.579462] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-34a3f5b1-e642-4184-95f7-7ad20ed36f5b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.579462] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-34a3f5b1-e642-4184-95f7-7ad20ed36f5b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.579735] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-34a3f5b1-e642-4184-95f7-7ad20ed36f5b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.579786] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('34a3f5b1-e642-4184-95f7-7ad20ed36f5b',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.581166] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-34a3f5b1-e642-4184-95f7-7ad20ed36f5b taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.581261] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34a3f5b1-e642-4184-95f7-7ad20ed36f5b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.581317] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34a3f5b1-e642-4184-95f7-7ad20ed36f5b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.582401] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34a3f5b1-e642-4184-95f7-7ad20ed36f5b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.582401] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.582401] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.582401] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.582401] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.582401] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.582401] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('34a3f5b1-e642-4184-95f7-7ad20ed36f5b',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.583510] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-9cfeb1d5-55e3-4fde-b744-60187f038153 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.583613] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9cfeb1d5-55e3-4fde-b744-60187f038153" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.583714] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9cfeb1d5-55e3-4fde-b744-60187f038153" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.583831] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9cfeb1d5-55e3-4fde-b744-60187f038153" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.583910] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9cfeb1d5-55e3-4fde-b744-60187f038153',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.655388] env[65337]: INFO networking_nsxv3.common.synchronization [req-c93b0682-4d00-49c2-a24d-cd059d41b25f req-0346983a-2e32-4eab-a7dd-bcf369aa55d8 tempest-ImagesTestJSON-1531636912 tempest-ImagesTestJSON-1531636912-project-member] Enqueued Resource ID: 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 with Priority: HIGHEST for action security_group_members [ 841.661558] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 with Priority: HIGHEST for action security_group_members [ 841.662043] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.662383] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.662560] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.662808] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.663042] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.663185] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.663279] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.663832] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.663928] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.665094] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7db87dc2-69af-45f1-90c2-f8a4ec96c3b7',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.817449] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('755f030a-6e7c-43ec-adb9-cb4c270ad532',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.821252] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cc860d7f-b6cd-4778-bbd7-a65ff0fc5bde',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.824775] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('231402d3-be76-4b4e-89eb-6d9b3908b60e',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.838158] env[65337]: INFO networking_nsxv3.common.synchronization [req-44368eae-c8eb-42ad-859b-05578e0b3f56 req-191d4195-f50a-426a-9fcc-0ec842f99217 tempest-ServerActionsTestOtherA-84911055 tempest-ServerActionsTestOtherA-84911055-project-member] Enqueued Resource ID: 61142fb1-6124-4f3b-93d1-d1ec51865066 with Priority: HIGHEST for action security_group_members [ 841.838831] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61142fb1-6124-4f3b-93d1-d1ec51865066 with Priority: HIGHEST for action security_group_members [ 841.839196] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-61142fb1-6124-4f3b-93d1-d1ec51865066 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.839352] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-61142fb1-6124-4f3b-93d1-d1ec51865066" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.839411] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-61142fb1-6124-4f3b-93d1-d1ec51865066" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.839580] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-61142fb1-6124-4f3b-93d1-d1ec51865066" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.839761] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.839859] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.839929] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.840126] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.840215] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.840320] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('61142fb1-6124-4f3b-93d1-d1ec51865066',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.048445] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock network-626 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.048637] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "network-626" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.048751] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "network-626" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.049105] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "network-626" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.049370] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.049524] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.049648] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.049862] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.049999] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.050211] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 842.050318] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 842.052067] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 842.052067] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 842.052067] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 842.052067] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 842.052067] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 842.071847] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 842.071976] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 842.072124] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 842.072297] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "network-626" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.072742] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock port-2993ff2e-8395-4181-8748-d0ea1009a686 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.072921] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "port-2993ff2e-8395-4181-8748-d0ea1009a686" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.073056] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "port-2993ff2e-8395-4181-8748-d0ea1009a686" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.073520] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "port-2993ff2e-8395-4181-8748-d0ea1009a686" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.073662] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2993ff2e-8395-4181-8748-d0ea1009a686',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.086397] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-34a3f5b1-e642-4184-95f7-7ad20ed36f5b taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.086397] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34a3f5b1-e642-4184-95f7-7ad20ed36f5b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.086665] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('34a3f5b1-e642-4184-95f7-7ad20ed36f5b',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.087563] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9cfeb1d5-55e3-4fde-b744-60187f038153 with status ACTIVE [ 842.087563] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.087563] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.087729] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.087775] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.087887] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.088037] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.088143] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.088208] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.088320] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.088699] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.088699] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.088699] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.088868] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.088868] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.088943] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.088985] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9cfeb1d5-55e3-4fde-b744-60187f038153 is going to be updated. [ 842.112080] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.112314] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.112314] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.112504] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.112633] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.112785] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9cfeb1d5-55e3-4fde-b744-60187f038153" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.167959] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7db87dc2-69af-45f1-90c2-f8a4ec96c3b7',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.320877] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.320877] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.320877] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.320877] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.320877] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.320877] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 755f030a-6e7c-43ec-adb9-cb4c270ad532 is going to be updated. [ 842.322952] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.323152] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.323224] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.323406] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.323494] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.323586] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc860d7f-b6cd-4778-bbd7-a65ff0fc5bde is going to be updated. [ 842.326990] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.327130] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.327178] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.327365] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.327449] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.327536] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 231402d3-be76-4b4e-89eb-6d9b3908b60e is going to be updated. [ 842.342203] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.342326] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.342380] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.342621] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.348745] env[65337]: INFO networking_nsxv3.common.synchronization [req-213d7861-d08a-465a-bdce-33a55ec0908f req-9a9d39a6-dcac-43e5-a66a-062c62a406f8 tempest-ServerExternalEventsTest-899198155 tempest-ServerExternalEventsTest-899198155-project-member] Enqueued Resource ID: 40a56e89-d484-4891-85a5-afa67f87b2d1 with Priority: HIGHEST for action security_group_members [ 842.349842] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40a56e89-d484-4891-85a5-afa67f87b2d1 with Priority: HIGHEST for action security_group_members [ 842.349842] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-40a56e89-d484-4891-85a5-afa67f87b2d1 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.349842] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40a56e89-d484-4891-85a5-afa67f87b2d1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.349842] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40a56e89-d484-4891-85a5-afa67f87b2d1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.350978] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40a56e89-d484-4891-85a5-afa67f87b2d1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.350978] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.350978] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.350978] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.350978] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.351320] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.351320] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('40a56e89-d484-4891-85a5-afa67f87b2d1',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.367549] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.367696] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.367780] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.367968] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.368320] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.369969] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.370108] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.370168] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.370346] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.370469] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.376588] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.376588] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.376588] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.376588] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.376588] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.377618] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.377827] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.377929] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.377989] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.378176] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.378249] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.378340] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 61142fb1-6124-4f3b-93d1-d1ec51865066 is going to be updated. [ 842.391054] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 755f030a-6e7c-43ec-adb9-cb4c270ad532 in Status: IN_PROGRESS for 2s [ 842.394772] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 231402d3-be76-4b4e-89eb-6d9b3908b60e in Status: IN_PROGRESS for 2s [ 842.395485] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc860d7f-b6cd-4778-bbd7-a65ff0fc5bde in Status: IN_PROGRESS for 2s [ 842.420526] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.420692] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.420750] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.420940] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.421100] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.430877] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 61142fb1-6124-4f3b-93d1-d1ec51865066 in Status: IN_PROGRESS for 2s [ 842.578154] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.578388] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.578522] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.579237] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.579237] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.579237] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Segment Port 2993ff2e-8395-4181-8748-d0ea1009a686 not found, creating... [ 842.579394] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.579554] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.579622] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.579903] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.581725] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.581725] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.581725] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.581725] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.581725] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.581725] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.581725] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Resource: SegmentPort with ID: 2993ff2e-8395-4181-8748-d0ea1009a686 is going to be created. [ 842.591021] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('34a3f5b1-e642-4184-95f7-7ad20ed36f5b',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.601830] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.602588] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.602588] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.602849] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.603093] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.603849] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "port-2993ff2e-8395-4181-8748-d0ea1009a686" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.670020] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7db87dc2-69af-45f1-90c2-f8a4ec96c3b7',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.853527] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.853527] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.853527] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.853960] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.853960] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.853960] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.854136] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.854136] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.854276] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.854382] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.854420] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40a56e89-d484-4891-85a5-afa67f87b2d1 is going to be updated. [ 842.884614] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.885247] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.885247] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.885247] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.885247] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.895156] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40a56e89-d484-4891-85a5-afa67f87b2d1 in Status: IN_PROGRESS for 2s [ 843.094063] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.094749] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.094749] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.094749] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.094749] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.094749] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34a3f5b1-e642-4184-95f7-7ad20ed36f5b is going to be created. [ 843.124089] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.124089] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.124089] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.124089] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.124089] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.133394] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34a3f5b1-e642-4184-95f7-7ad20ed36f5b in Status: UNINITIALIZED for 2s [ 843.174170] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.174755] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.174851] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.175092] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.175187] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.175288] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 is going to be updated. [ 843.210321] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.210511] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.210511] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.210758] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.210937] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.220511] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 in Status: IN_PROGRESS for 2s [ 843.332489] env[65337]: INFO networking_nsxv3.common.synchronization [req-c93b0682-4d00-49c2-a24d-cd059d41b25f req-6bba6eae-cc12-4ceb-a6cd-0b9f8adb788e service nova] Enqueued Resource ID: 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 with Priority: HIGHEST for action security_group_rules [ 843.332756] env[65337]: INFO networking_nsxv3.common.synchronization [req-c93b0682-4d00-49c2-a24d-cd059d41b25f req-6bba6eae-cc12-4ceb-a6cd-0b9f8adb788e service nova] Enqueued Resource ID: 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 with Priority: HIGHEST for action security_group_members [ 843.332825] env[65337]: INFO networking_nsxv3.common.synchronization [req-c93b0682-4d00-49c2-a24d-cd059d41b25f req-6bba6eae-cc12-4ceb-a6cd-0b9f8adb788e service nova] Enqueued Resource ID: 2993ff2e-8395-4181-8748-d0ea1009a686 with Priority: HIGHEST for action port [ 843.333381] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 with Priority: HIGHEST for action security_group_rules [ 843.333505] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 with Priority: HIGHEST for action security_group_members [ 843.333638] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2993ff2e-8395-4181-8748-d0ea1009a686 with Priority: HIGHEST for action port [ 843.334068] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.334068] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.334914] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.335205] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.335286] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7db87dc2-69af-45f1-90c2-f8a4ec96c3b7',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.336754] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.336754] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.336855] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-2993ff2e-8395-4181-8748-d0ea1009a686 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.336921] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2993ff2e-8395-4181-8748-d0ea1009a686" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.337468] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2993ff2e-8395-4181-8748-d0ea1009a686" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.337468] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2993ff2e-8395-4181-8748-d0ea1009a686" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.337468] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2993ff2e-8395-4181-8748-d0ea1009a686',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.839403] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.839566] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.839761] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2993ff2e-8395-4181-8748-d0ea1009a686 with status ACTIVE [ 843.839950] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.840154] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.840154] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.840390] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.840469] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.840664] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.840745] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.840786] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.840955] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.841024] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.841226] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.841344] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.841414] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.841564] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.841635] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.841779] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2993ff2e-8395-4181-8748-d0ea1009a686 is going to be updated. [ 843.864216] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.864216] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.864216] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.864609] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.864609] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.864609] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2993ff2e-8395-4181-8748-d0ea1009a686" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.403785] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 755f030a-6e7c-43ec-adb9-cb4c270ad532 in Status: SUCCESS [ 844.404015] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.404158] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.404494] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.404782] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.404782] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.404782] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.404939] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.405069] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.405133] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.405224] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('755f030a-6e7c-43ec-adb9-cb4c270ad532',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.406851] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc860d7f-b6cd-4778-bbd7-a65ff0fc5bde in Status: SUCCESS [ 844.407079] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc860d7f-b6cd-4778-bbd7-a65ff0fc5bde" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.407747] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 231402d3-be76-4b4e-89eb-6d9b3908b60e in Status: SUCCESS [ 844.407927] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-231402d3-be76-4b4e-89eb-6d9b3908b60e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.408083] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.408326] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.408442] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.408579] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.408670] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.408764] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.408820] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.408919] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('755f030a-6e7c-43ec-adb9-cb4c270ad532',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.409990] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc860d7f-b6cd-4778-bbd7-a65ff0fc5bde" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.410197] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc860d7f-b6cd-4778-bbd7-a65ff0fc5bde" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.410881] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.410881] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.410881] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.410881] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.410881] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.410881] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc860d7f-b6cd-4778-bbd7-a65ff0fc5bde" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.411178] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cc860d7f-b6cd-4778-bbd7-a65ff0fc5bde',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.411599] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-231402d3-be76-4b4e-89eb-6d9b3908b60e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.411975] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-231402d3-be76-4b4e-89eb-6d9b3908b60e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.411975] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.412088] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.412610] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.412610] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.412610] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.412610] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-231402d3-be76-4b4e-89eb-6d9b3908b60e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.412610] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('231402d3-be76-4b4e-89eb-6d9b3908b60e',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.415278] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc860d7f-b6cd-4778-bbd7-a65ff0fc5bde" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.415278] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc860d7f-b6cd-4778-bbd7-a65ff0fc5bde" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.415278] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.415278] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.415278] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.415278] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.415278] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.415278] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc860d7f-b6cd-4778-bbd7-a65ff0fc5bde',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.415278] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-231402d3-be76-4b4e-89eb-6d9b3908b60e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.415703] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-231402d3-be76-4b4e-89eb-6d9b3908b60e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.415703] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.415703] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.415703] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.415886] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.415886] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.415886] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('231402d3-be76-4b4e-89eb-6d9b3908b60e',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.443207] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 61142fb1-6124-4f3b-93d1-d1ec51865066 in Status: SUCCESS [ 844.443207] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 61142fb1-6124-4f3b-93d1-d1ec51865066 deletion is rescheduled due to dependency. [ 844.443207] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-61142fb1-6124-4f3b-93d1-d1ec51865066" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.905789] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40a56e89-d484-4891-85a5-afa67f87b2d1 in Status: SUCCESS [ 844.906184] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40a56e89-d484-4891-85a5-afa67f87b2d1 deletion is rescheduled due to dependency. [ 844.906227] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40a56e89-d484-4891-85a5-afa67f87b2d1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.913808] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-755f030a-6e7c-43ec-adb9-cb4c270ad532 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.913987] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.914227] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('755f030a-6e7c-43ec-adb9-cb4c270ad532',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.915204] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cc860d7f-b6cd-4778-bbd7-a65ff0fc5bde',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.918029] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('231402d3-be76-4b4e-89eb-6d9b3908b60e',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.918029] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.918029] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.918029] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.918462] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.918462] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.918622] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.919395] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.919395] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.919395] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.919395] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.919395] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc860d7f-b6cd-4778-bbd7-a65ff0fc5bde is going to be updated. [ 844.921919] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.922082] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.922267] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.922408] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.922445] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.923248] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.923248] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.923248] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.923248] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.923248] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.923248] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 231402d3-be76-4b4e-89eb-6d9b3908b60e is going to be deleted. [ 844.955436] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.955657] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.955756] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.955974] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.956133] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.968314] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc860d7f-b6cd-4778-bbd7-a65ff0fc5bde in Status: IN_PROGRESS for 2s [ 844.987879] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.987879] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.987879] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.988520] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.988520] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.988520] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-231402d3-be76-4b4e-89eb-6d9b3908b60e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.143802] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34a3f5b1-e642-4184-95f7-7ad20ed36f5b in Status: SUCCESS [ 845.144042] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34a3f5b1-e642-4184-95f7-7ad20ed36f5b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.144261] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34a3f5b1-e642-4184-95f7-7ad20ed36f5b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.144436] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34a3f5b1-e642-4184-95f7-7ad20ed36f5b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.144658] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.144814] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.144907] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.144976] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.145063] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.145143] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34a3f5b1-e642-4184-95f7-7ad20ed36f5b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.145235] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('34a3f5b1-e642-4184-95f7-7ad20ed36f5b',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.231842] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 in Status: SUCCESS [ 845.231842] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.231842] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.231842] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.231842] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.231842] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.231842] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.231842] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.231842] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.231842] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7db87dc2-69af-45f1-90c2-f8a4ec96c3b7',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.416904] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('755f030a-6e7c-43ec-adb9-cb4c270ad532',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.418038] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cc860d7f-b6cd-4778-bbd7-a65ff0fc5bde: rpc.has_security_group_logging(os_id): False [ 845.421993] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 231402d3-be76-4b4e-89eb-6d9b3908b60e: rpc.has_security_group_logging(os_id): False [ 845.448065] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.448322] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.448322] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.449053] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.449053] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.449053] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.449658] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.449658] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.449658] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.449658] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.449658] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cc860d7f-b6cd-4778-bbd7-a65ff0fc5bde is going to be updated. [ 845.452317] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.452480] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.452564] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.452940] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.453127] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.453504] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.453712] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.453966] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.454042] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.454110] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.454265] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 231402d3-be76-4b4e-89eb-6d9b3908b60e is going to be created. [ 845.501426] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/231402d3-be76-4b4e-89eb-6d9b3908b60e], does not exist path=[/infra/domains/default/groups/231402d3-be76-4b4e-89eb-6d9b3908b60e]."\n}' [ 845.501774] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 231402d3-be76-4b4e-89eb-6d9b3908b60e failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/231402d3-be76-4b4e-89eb-6d9b3908b60e [ 845.501774] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 845.560485] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.560485] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.560485] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.560982] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.564027] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.564027] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.564027] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.564027] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.564027] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.564027] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.564027] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.564633] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.564633] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.564721] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.564937] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.565086] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 231402d3-be76-4b4e-89eb-6d9b3908b60e is going to be created. [ 845.588298] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.588298] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.588298] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.588298] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.588298] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.596352] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/231402d3-be76-4b4e-89eb-6d9b3908b60e], does not exist path=[/infra/domains/default/groups/231402d3-be76-4b4e-89eb-6d9b3908b60e]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/231402d3-be76-4b4e-89eb-6d9b3908b60e [ 845.597355] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-231402d3-be76-4b4e-89eb-6d9b3908b60e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.597355] env[65337]: Traceback (most recent call last): [ 845.597355] env[65337]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 845.597355] env[65337]: return func(*args, **kwargs) [ 845.597355] env[65337]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 845.597355] env[65337]: res.raise_for_status() [ 845.597355] env[65337]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 845.597355] env[65337]: raise HTTPError(http_error_msg, response=self) [ 845.597355] env[65337]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/231402d3-be76-4b4e-89eb-6d9b3908b60e [ 845.597355] env[65337]: During handling of the above exception, another exception occurred: [ 845.597355] env[65337]: Traceback (most recent call last): [ 845.597355] env[65337]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 845.597355] env[65337]: listener.cb(fileno) [ 845.597355] env[65337]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 845.597355] env[65337]: result = function(*args, **kwargs) [ 845.597355] env[65337]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 845.597355] env[65337]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 845.597355] env[65337]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 845.597355] env[65337]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 845.597355] env[65337]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 845.597355] env[65337]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 845.597355] env[65337]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 845.597355] env[65337]: res.raise_for_status() [ 845.597355] env[65337]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 845.597355] env[65337]: raise HTTPError(http_error_msg, response=self) [ 845.597355] env[65337]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/231402d3-be76-4b4e-89eb-6d9b3908b60e [ 845.597355] env[65337]: Removing descriptor: 60 [ 845.603168] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc860d7f-b6cd-4778-bbd7-a65ff0fc5bde in Status: IN_PROGRESS for 2s [ 845.647819] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-34a3f5b1-e642-4184-95f7-7ad20ed36f5b taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.648043] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34a3f5b1-e642-4184-95f7-7ad20ed36f5b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.648090] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34a3f5b1-e642-4184-95f7-7ad20ed36f5b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.648296] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34a3f5b1-e642-4184-95f7-7ad20ed36f5b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.648471] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.648570] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.648630] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.648853] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.648957] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.649079] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34a3f5b1-e642-4184-95f7-7ad20ed36f5b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.649208] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-34a3f5b1-e642-4184-95f7-7ad20ed36f5b taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.649317] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34a3f5b1-e642-4184-95f7-7ad20ed36f5b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.649384] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34a3f5b1-e642-4184-95f7-7ad20ed36f5b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.649512] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34a3f5b1-e642-4184-95f7-7ad20ed36f5b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.649669] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.649770] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.649846] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.649961] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.650059] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.650135] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34a3f5b1-e642-4184-95f7-7ad20ed36f5b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.650223] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('34a3f5b1-e642-4184-95f7-7ad20ed36f5b',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.693336] env[65337]: INFO networking_nsxv3.common.synchronization [req-cdfb8218-0d60-48e9-9b3c-ea5c0fc3dc54 req-395e4b2b-931b-48c1-b52e-a1cfb1671156 tempest-MigrationsAdminTest-367558634 tempest-MigrationsAdminTest-367558634-project-member] Enqueued Resource ID: d8e2d833-6da9-488a-a2b1-f410f4205706 with Priority: HIGHEST for action security_group_members [ 845.694285] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8e2d833-6da9-488a-a2b1-f410f4205706 with Priority: HIGHEST for action security_group_members [ 845.694679] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8e2d833-6da9-488a-a2b1-f410f4205706 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.694821] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8e2d833-6da9-488a-a2b1-f410f4205706" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.694891] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8e2d833-6da9-488a-a2b1-f410f4205706" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.695143] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8e2d833-6da9-488a-a2b1-f410f4205706" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.695310] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.695414] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.695478] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.695651] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.695746] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.695843] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d8e2d833-6da9-488a-a2b1-f410f4205706',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.735048] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7db87dc2-69af-45f1-90c2-f8a4ec96c3b7',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.920222] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.920563] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.920563] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.920563] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.920696] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.920741] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 755f030a-6e7c-43ec-adb9-cb4c270ad532 is going to be updated. [ 845.966896] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.967078] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.967151] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.967363] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.967509] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.976804] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 755f030a-6e7c-43ec-adb9-cb4c270ad532 in Status: IN_PROGRESS for 2s [ 846.152171] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 34a3f5b1-e642-4184-95f7-7ad20ed36f5b: rpc.has_security_group_logging(os_id): False [ 846.176178] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.176178] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.176178] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.176178] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.176178] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.176178] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.176178] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.176178] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.176178] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.176178] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.177292] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.177594] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.177754] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.181401] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.181401] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.181401] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.181401] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.181401] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.181401] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.181401] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.181401] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 34a3f5b1-e642-4184-95f7-7ad20ed36f5b is going to be created. [ 846.198253] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d8e2d833-6da9-488a-a2b1-f410f4205706',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.239693] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7db87dc2-69af-45f1-90c2-f8a4ec96c3b7',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.254235] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.254235] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.254235] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.254235] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.254235] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.277442] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 34a3f5b1-e642-4184-95f7-7ad20ed36f5b in Status: IN_PROGRESS for 2s [ 846.701551] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d8e2d833-6da9-488a-a2b1-f410f4205706',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.711176] env[65337]: INFO networking_nsxv3.common.synchronization [req-7128908f-53e6-4f4b-99fb-eb544f70d107 req-1314a4d3-2cf1-4e22-8104-1e18eb3c5584 tempest-ServersAdminNegativeTestJSON-683436170 tempest-ServersAdminNegativeTestJSON-683436170-project-member] Enqueued Resource ID: d9afc808-3692-46b5-a84b-018d8d2b7f94 with Priority: HIGHEST for action security_group_members [ 846.712711] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9afc808-3692-46b5-a84b-018d8d2b7f94 with Priority: HIGHEST for action security_group_members [ 846.713123] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9afc808-3692-46b5-a84b-018d8d2b7f94 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.713483] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9afc808-3692-46b5-a84b-018d8d2b7f94" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.713560] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9afc808-3692-46b5-a84b-018d8d2b7f94" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.713858] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9afc808-3692-46b5-a84b-018d8d2b7f94" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.714079] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.714240] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.714340] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.714543] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.714716] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.714857] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d9afc808-3692-46b5-a84b-018d8d2b7f94',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.743638] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.743824] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.743884] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.744181] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.744365] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.744365] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 is going to be updated. [ 846.816993] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.817589] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.817589] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.817725] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.819020] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.833265] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 in Status: IN_PROGRESS for 2s [ 846.979875] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc860d7f-b6cd-4778-bbd7-a65ff0fc5bde in Status: SUCCESS [ 846.981313] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc860d7f-b6cd-4778-bbd7-a65ff0fc5bde deletion is rescheduled due to dependency. [ 846.981449] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc860d7f-b6cd-4778-bbd7-a65ff0fc5bde" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.204778] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.204982] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.204982] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.205179] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.205286] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.205411] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8e2d833-6da9-488a-a2b1-f410f4205706 is going to be updated. [ 847.217725] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.217868] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.217917] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.218172] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.241921] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.242278] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.242404] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.242473] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.242679] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.242764] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.242852] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d9afc808-3692-46b5-a84b-018d8d2b7f94 is going to be updated. [ 847.257442] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.257636] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.257742] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.257960] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.258117] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.265940] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8e2d833-6da9-488a-a2b1-f410f4205706 in Status: IN_PROGRESS for 2s [ 847.303055] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.305268] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.305268] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.305268] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.305268] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.324536] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d9afc808-3692-46b5-a84b-018d8d2b7f94 in Status: IN_PROGRESS for 2s [ 847.625980] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc860d7f-b6cd-4778-bbd7-a65ff0fc5bde in Status: SUCCESS [ 847.626249] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cc860d7f-b6cd-4778-bbd7-a65ff0fc5bde" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.987892] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 755f030a-6e7c-43ec-adb9-cb4c270ad532 in Status: SUCCESS [ 847.987892] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.988378] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.988435] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.988661] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.988787] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.988885] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.989106] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.989225] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.989544] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.989768] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-755f030a-6e7c-43ec-adb9-cb4c270ad532 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.989963] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.990093] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.990211] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.990339] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.990499] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.990541] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.990778] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.990927] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.991172] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.991230] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('755f030a-6e7c-43ec-adb9-cb4c270ad532',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.299970] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 34a3f5b1-e642-4184-95f7-7ad20ed36f5b in Status: SUCCESS [ 848.300454] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-34a3f5b1-e642-4184-95f7-7ad20ed36f5b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.493306] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 755f030a-6e7c-43ec-adb9-cb4c270ad532: rpc.has_security_group_logging(os_id): False [ 848.514141] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.514141] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.514141] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.514141] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.523907] env[65337]: INFO networking_nsxv3.common.synchronization [req-65b0cf66-df88-4ba6-bcda-80367698ab84 req-a3cec1c9-6db6-419c-8d65-b1d0fa6492f4 tempest-ServerDiskConfigTestJSON-1745593668 tempest-ServerDiskConfigTestJSON-1745593668-project-member] Enqueued Resource ID: 653446ea-2b31-43b8-a920-884274265c75 with Priority: HIGHEST for action security_group_members [ 848.524855] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 653446ea-2b31-43b8-a920-884274265c75 with Priority: HIGHEST for action security_group_members [ 848.524968] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-653446ea-2b31-43b8-a920-884274265c75 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.525108] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.525172] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.525370] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.525522] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.525633] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.526265] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.526265] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.526265] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.526265] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('653446ea-2b31-43b8-a920-884274265c75',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.538244] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.538244] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.538244] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.538244] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.538244] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.538244] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.538244] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.538244] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.538244] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.538244] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.538244] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.538244] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.538244] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.538244] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.538841] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.538841] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.539053] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 755f030a-6e7c-43ec-adb9-cb4c270ad532 is going to be updated. [ 848.611052] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.611052] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.611052] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.611052] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.611300] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.630060] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 755f030a-6e7c-43ec-adb9-cb4c270ad532 in Status: IN_PROGRESS for 2s [ 848.845302] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 in Status: SUCCESS [ 848.845581] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.845748] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.845947] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.846162] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.846314] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.846379] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.846546] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.846631] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.846719] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.846801] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7db87dc2-69af-45f1-90c2-f8a4ec96c3b7',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.885763] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock network-73 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.885978] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "network-73" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.886126] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "network-73" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.886380] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "network-73" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.886645] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.886798] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.887083] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.887166] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.887293] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.887492] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 848.887601] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 848.887708] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 848.887817] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 848.887923] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 848.888034] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 848.888164] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 848.908387] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 848.908387] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 848.908387] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 848.908387] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "network-73" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.908635] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock port-77f6dee6-6cba-48e9-8a18-7e13098ce5a0 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.908635] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "port-77f6dee6-6cba-48e9-8a18-7e13098ce5a0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.908755] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "port-77f6dee6-6cba-48e9-8a18-7e13098ce5a0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.909023] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "port-77f6dee6-6cba-48e9-8a18-7e13098ce5a0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.909161] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('77f6dee6-6cba-48e9-8a18-7e13098ce5a0',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.028601] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.029039] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.029039] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.029280] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.030066] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.030300] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.030479] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.030479] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.030658] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.030744] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.030834] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 653446ea-2b31-43b8-a920-884274265c75 is going to be deleted. [ 849.061220] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.061401] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.061458] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.061757] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.061757] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.061914] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.288220] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8e2d833-6da9-488a-a2b1-f410f4205706 in Status: SUCCESS [ 849.288475] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8e2d833-6da9-488a-a2b1-f410f4205706" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.334040] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d9afc808-3692-46b5-a84b-018d8d2b7f94 in Status: SUCCESS [ 849.334249] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d9afc808-3692-46b5-a84b-018d8d2b7f94 deletion is rescheduled due to dependency. [ 849.334363] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9afc808-3692-46b5-a84b-018d8d2b7f94" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.348986] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.349175] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.349248] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.349475] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.349653] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.349744] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.349810] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.349966] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.350066] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.350158] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.350310] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.351037] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.351037] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.351037] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.351037] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.351037] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.351037] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.351037] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.351580] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.351580] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.351580] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7db87dc2-69af-45f1-90c2-f8a4ec96c3b7',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.412988] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.413225] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.413459] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.413727] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.413931] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.414102] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Segment Port 77f6dee6-6cba-48e9-8a18-7e13098ce5a0 not found, creating... [ 849.414419] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.414577] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.414764] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.414998] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.415150] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.415428] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.415577] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.415725] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.415944] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.416087] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.416222] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Resource: SegmentPort with ID: 77f6dee6-6cba-48e9-8a18-7e13098ce5a0 is going to be created. [ 849.436844] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.437076] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.437168] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.437543] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.437709] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.437926] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "port-77f6dee6-6cba-48e9-8a18-7e13098ce5a0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.854817] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7: rpc.has_security_group_logging(os_id): False [ 849.878287] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.878442] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.878558] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.878723] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.904311] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.904692] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.904839] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.904839] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.905038] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.905127] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.905346] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.905455] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.905517] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.905835] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.905835] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.905951] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.906058] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.906119] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.906258] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.906333] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.906416] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 is going to be updated. [ 849.987841] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.987841] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.987841] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.988406] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.988406] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.006068] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 in Status: IN_PROGRESS for 2s [ 850.200609] env[65337]: INFO networking_nsxv3.common.synchronization [req-65b0cf66-df88-4ba6-bcda-80367698ab84 req-ccd62f1e-086e-4253-8ecb-ff7601d653ae service nova] Enqueued Resource ID: 653446ea-2b31-43b8-a920-884274265c75 with Priority: HIGHEST for action security_group_rules [ 850.200879] env[65337]: INFO networking_nsxv3.common.synchronization [req-65b0cf66-df88-4ba6-bcda-80367698ab84 req-ccd62f1e-086e-4253-8ecb-ff7601d653ae service nova] Enqueued Resource ID: 653446ea-2b31-43b8-a920-884274265c75 with Priority: HIGHEST for action security_group_members [ 850.200971] env[65337]: INFO networking_nsxv3.common.synchronization [req-65b0cf66-df88-4ba6-bcda-80367698ab84 req-ccd62f1e-086e-4253-8ecb-ff7601d653ae service nova] Enqueued Resource ID: 77f6dee6-6cba-48e9-8a18-7e13098ce5a0 with Priority: HIGHEST for action port [ 850.201753] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 653446ea-2b31-43b8-a920-884274265c75 with Priority: HIGHEST for action security_group_rules [ 850.201753] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 653446ea-2b31-43b8-a920-884274265c75 with Priority: HIGHEST for action security_group_members [ 850.201753] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77f6dee6-6cba-48e9-8a18-7e13098ce5a0 with Priority: HIGHEST for action port [ 850.201983] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-653446ea-2b31-43b8-a920-884274265c75 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.202118] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.202248] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.202387] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.202767] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('653446ea-2b31-43b8-a920-884274265c75',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.203879] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-653446ea-2b31-43b8-a920-884274265c75 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.204008] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.204090] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.204313] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.209037] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.209037] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.209037] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.209037] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.209037] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.209037] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('653446ea-2b31-43b8-a920-884274265c75',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.209037] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-77f6dee6-6cba-48e9-8a18-7e13098ce5a0 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.209037] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-77f6dee6-6cba-48e9-8a18-7e13098ce5a0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.209037] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-77f6dee6-6cba-48e9-8a18-7e13098ce5a0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.209037] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-77f6dee6-6cba-48e9-8a18-7e13098ce5a0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.209037] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('77f6dee6-6cba-48e9-8a18-7e13098ce5a0',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.654952] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 755f030a-6e7c-43ec-adb9-cb4c270ad532 in Status: SUCCESS [ 850.655434] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.704615] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-653446ea-2b31-43b8-a920-884274265c75 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.704830] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.711428] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 77f6dee6-6cba-48e9-8a18-7e13098ce5a0 with status ACTIVE [ 850.711701] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.711796] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.711862] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.712284] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.712392] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.712620] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.712752] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.712819] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.712991] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.713084] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.713356] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.713455] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.713516] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.713660] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.713834] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.713834] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 77f6dee6-6cba-48e9-8a18-7e13098ce5a0 is going to be updated. [ 850.715266] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('653446ea-2b31-43b8-a920-884274265c75',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.749868] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.750138] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.750246] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.750517] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.750766] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.750953] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-77f6dee6-6cba-48e9-8a18-7e13098ce5a0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.217922] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('653446ea-2b31-43b8-a920-884274265c75',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.720097] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.720097] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.720097] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.720386] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.720425] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.720507] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 653446ea-2b31-43b8-a920-884274265c75 is going to be created. [ 851.764174] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.764377] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.764377] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.765191] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.765191] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.779085] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 653446ea-2b31-43b8-a920-884274265c75 in Status: UNINITIALIZED for 2s [ 852.021901] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 in Status: SUCCESS [ 852.021901] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.186076] env[65337]: INFO networking_nsxv3.common.synchronization [req-92fb5bc4-e21c-4c6a-8c1d-49f6201044ff req-f0cd5a5d-3d7c-471a-8a2e-6441bee19b24 tempest-ServerGroupTestJSON-123689168 tempest-ServerGroupTestJSON-123689168-project-member] Enqueued Resource ID: 34a3f5b1-e642-4184-95f7-7ad20ed36f5b with Priority: HIGHEST for action security_group_members [ 853.186698] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34a3f5b1-e642-4184-95f7-7ad20ed36f5b with Priority: HIGHEST for action security_group_members [ 853.187046] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-34a3f5b1-e642-4184-95f7-7ad20ed36f5b taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.187300] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34a3f5b1-e642-4184-95f7-7ad20ed36f5b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.187300] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34a3f5b1-e642-4184-95f7-7ad20ed36f5b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.187482] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34a3f5b1-e642-4184-95f7-7ad20ed36f5b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.187584] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.187683] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.187737] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.187884] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.187967] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.188087] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('34a3f5b1-e642-4184-95f7-7ad20ed36f5b',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.535290] env[65337]: INFO networking_nsxv3.common.synchronization [req-c5185206-c089-4041-ab04-5d7414870b4e req-e382d407-ff46-4af3-8c57-3096aa630014 tempest-ServersTestJSON-1910122825 tempest-ServersTestJSON-1910122825-project-member] Enqueued Resource ID: af1da677-d95a-4cec-95fa-b9208101b7dd with Priority: HIGHEST for action security_group_members [ 853.536022] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af1da677-d95a-4cec-95fa-b9208101b7dd with Priority: HIGHEST for action security_group_members [ 853.536208] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-af1da677-d95a-4cec-95fa-b9208101b7dd taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.536331] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.536404] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.536651] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.536803] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.537060] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.537060] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.537144] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.537259] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.537303] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('af1da677-d95a-4cec-95fa-b9208101b7dd',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.691448] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.691654] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.691654] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.691787] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.692196] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.692196] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.692196] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.692196] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.692560] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.692560] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.692560] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34a3f5b1-e642-4184-95f7-7ad20ed36f5b is going to be updated. [ 853.728315] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.728491] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.728594] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.728897] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.728990] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.743806] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34a3f5b1-e642-4184-95f7-7ad20ed36f5b in Status: IN_PROGRESS for 2s [ 853.800058] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 653446ea-2b31-43b8-a920-884274265c75 in Status: SUCCESS [ 853.800058] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.800058] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.800058] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.800058] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.800058] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.800058] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.800058] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.800058] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.800058] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.800058] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('653446ea-2b31-43b8-a920-884274265c75',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.928828] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock network-48 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.929065] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "network-48" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.929187] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "network-48" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.929514] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "network-48" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.929787] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.929948] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.930296] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.930557] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.930719] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.930935] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 853.931061] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 853.931166] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 853.931273] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 853.931380] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 853.931483] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 853.931617] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 853.954350] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 853.954521] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 853.954567] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 853.954908] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "network-48" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.955245] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock port-19da8597-76b8-487e-adfc-4bd760cc6cf5 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.955421] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "port-19da8597-76b8-487e-adfc-4bd760cc6cf5" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.955539] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "port-19da8597-76b8-487e-adfc-4bd760cc6cf5" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.955925] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "port-19da8597-76b8-487e-adfc-4bd760cc6cf5" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.956083] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('19da8597-76b8-487e-adfc-4bd760cc6cf5',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.039967] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.039967] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.039967] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.039967] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.040216] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.040216] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.040303] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.040354] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.040515] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.040631] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.040748] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: af1da677-d95a-4cec-95fa-b9208101b7dd already deleted. [ 854.040868] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.302305] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-653446ea-2b31-43b8-a920-884274265c75 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.302669] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.302669] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.303059] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.303406] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.303406] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.303549] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.303595] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.303684] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.303782] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.304073] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-653446ea-2b31-43b8-a920-884274265c75 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.304183] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.304268] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.304453] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.304700] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.304865] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.305105] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.305913] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.306038] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.306141] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.306339] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('653446ea-2b31-43b8-a920-884274265c75',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.459483] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.459666] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.459776] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.460063] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.460214] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.460371] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Segment Port 19da8597-76b8-487e-adfc-4bd760cc6cf5 not found, creating... [ 854.460639] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.460788] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.460940] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.461200] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.461364] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.461617] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.461766] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.461877] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.462113] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.462247] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.462386] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Resource: SegmentPort with ID: 19da8597-76b8-487e-adfc-4bd760cc6cf5 is going to be created. [ 854.490549] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.490804] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.490921] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.492036] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.492036] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.492036] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "port-19da8597-76b8-487e-adfc-4bd760cc6cf5" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.809013] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 653446ea-2b31-43b8-a920-884274265c75: rpc.has_security_group_logging(os_id): False [ 854.834267] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.834493] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.834554] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.834904] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.835033] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.835259] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.835366] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.835431] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.835677] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.836293] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.836995] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.837219] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.837349] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.837663] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.837796] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.838176] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.838363] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.838811] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.839103] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.839242] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.839422] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 653446ea-2b31-43b8-a920-884274265c75 is going to be created. [ 854.917664] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.917824] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.917896] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.918166] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.918468] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.937364] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 653446ea-2b31-43b8-a920-884274265c75 in Status: IN_PROGRESS for 2s [ 855.244414] env[65337]: INFO networking_nsxv3.common.synchronization [req-c5185206-c089-4041-ab04-5d7414870b4e req-3d752614-a8c1-4f30-9a64-ad9b8c1dde85 service nova] Enqueued Resource ID: af1da677-d95a-4cec-95fa-b9208101b7dd with Priority: HIGHEST for action security_group_rules [ 855.244414] env[65337]: INFO networking_nsxv3.common.synchronization [req-c5185206-c089-4041-ab04-5d7414870b4e req-3d752614-a8c1-4f30-9a64-ad9b8c1dde85 service nova] Enqueued Resource ID: af1da677-d95a-4cec-95fa-b9208101b7dd with Priority: HIGHEST for action security_group_members [ 855.244414] env[65337]: INFO networking_nsxv3.common.synchronization [req-c5185206-c089-4041-ab04-5d7414870b4e req-3d752614-a8c1-4f30-9a64-ad9b8c1dde85 service nova] Enqueued Resource ID: 19da8597-76b8-487e-adfc-4bd760cc6cf5 with Priority: HIGHEST for action port [ 855.244414] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af1da677-d95a-4cec-95fa-b9208101b7dd with Priority: HIGHEST for action security_group_rules [ 855.244414] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af1da677-d95a-4cec-95fa-b9208101b7dd with Priority: HIGHEST for action security_group_members [ 855.244414] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19da8597-76b8-487e-adfc-4bd760cc6cf5 with Priority: HIGHEST for action port [ 855.244414] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-af1da677-d95a-4cec-95fa-b9208101b7dd taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.244414] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.244414] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.246204] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.246204] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('af1da677-d95a-4cec-95fa-b9208101b7dd',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.247177] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-af1da677-d95a-4cec-95fa-b9208101b7dd taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.247426] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.247600] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.247875] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.249117] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.249117] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.249117] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.249117] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.249117] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.249117] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('af1da677-d95a-4cec-95fa-b9208101b7dd',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.252052] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-19da8597-76b8-487e-adfc-4bd760cc6cf5 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.252900] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-19da8597-76b8-487e-adfc-4bd760cc6cf5" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.252900] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-19da8597-76b8-487e-adfc-4bd760cc6cf5" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.252900] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-19da8597-76b8-487e-adfc-4bd760cc6cf5" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.255153] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('19da8597-76b8-487e-adfc-4bd760cc6cf5',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.754429] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34a3f5b1-e642-4184-95f7-7ad20ed36f5b in Status: SUCCESS [ 855.754766] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34a3f5b1-e642-4184-95f7-7ad20ed36f5b deletion is rescheduled due to dependency. [ 855.754820] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34a3f5b1-e642-4184-95f7-7ad20ed36f5b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.755173] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-af1da677-d95a-4cec-95fa-b9208101b7dd taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.755305] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.755559] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('af1da677-d95a-4cec-95fa-b9208101b7dd',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.760022] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 19da8597-76b8-487e-adfc-4bd760cc6cf5 with status ACTIVE [ 855.760022] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.760022] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.760022] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.760022] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.760022] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.760022] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.760022] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.760022] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.760022] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.760022] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.760022] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.760022] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.760022] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.760022] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.760022] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.760022] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 19da8597-76b8-487e-adfc-4bd760cc6cf5 is going to be updated. [ 855.780721] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.780821] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.780821] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.781032] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.781170] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.781321] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-19da8597-76b8-487e-adfc-4bd760cc6cf5" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.258235] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('af1da677-d95a-4cec-95fa-b9208101b7dd',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.761524] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.761812] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.761812] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.761960] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.762112] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.762160] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: af1da677-d95a-4cec-95fa-b9208101b7dd is going to be created. [ 856.787340] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.787486] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.787486] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.788062] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.788062] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.799215] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af1da677-d95a-4cec-95fa-b9208101b7dd in Status: UNINITIALIZED for 2s [ 856.956625] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 653446ea-2b31-43b8-a920-884274265c75 in Status: SUCCESS [ 856.956625] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.221054] env[65337]: INFO networking_nsxv3.common.synchronization [req-082221ce-044c-4fd2-999d-d6905d1344f8 req-c2053ead-383b-44a7-bf6a-4b6a4007f963 tempest-ServersAdminTestJSON-283641549 tempest-ServersAdminTestJSON-283641549-project-member] Enqueued Resource ID: 9e889ce7-965a-4de0-b096-60d4e743cf8b with Priority: HIGHEST for action security_group_members [ 858.221472] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e889ce7-965a-4de0-b096-60d4e743cf8b with Priority: HIGHEST for action security_group_members [ 858.221518] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e889ce7-965a-4de0-b096-60d4e743cf8b taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.221640] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.221741] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.221971] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.222805] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.222805] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.222805] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.222805] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.222805] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.222805] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e889ce7-965a-4de0-b096-60d4e743cf8b',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.726098] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9e889ce7-965a-4de0-b096-60d4e743cf8b',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.810515] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af1da677-d95a-4cec-95fa-b9208101b7dd in Status: SUCCESS [ 858.811266] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.811445] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.811828] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.812039] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.812339] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.812434] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.812654] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.812803] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.813042] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.813147] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('af1da677-d95a-4cec-95fa-b9208101b7dd',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.228339] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9e889ce7-965a-4de0-b096-60d4e743cf8b',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.315898] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-af1da677-d95a-4cec-95fa-b9208101b7dd taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.315898] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.315898] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.315898] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.315898] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.315898] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.316329] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.316329] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.316329] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.316329] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.316481] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-af1da677-d95a-4cec-95fa-b9208101b7dd taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.316531] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.316570] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.317407] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.317407] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.317407] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.317407] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.317407] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.317407] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.317407] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.317407] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('af1da677-d95a-4cec-95fa-b9208101b7dd',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.732340] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.732431] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.732479] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.732746] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.732873] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.732962] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e889ce7-965a-4de0-b096-60d4e743cf8b is going to be updated. [ 859.776128] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.776282] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.776395] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.776624] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.776779] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.788599] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e889ce7-965a-4de0-b096-60d4e743cf8b in Status: IN_PROGRESS for 2s [ 859.820699] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for af1da677-d95a-4cec-95fa-b9208101b7dd: rpc.has_security_group_logging(os_id): False [ 859.841825] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.842046] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.842223] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.842405] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.842561] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.842799] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.843082] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.843148] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.843386] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.843386] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.843601] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.843744] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.843786] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.843922] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.844073] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.844248] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.844400] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.844463] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.844580] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.844725] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.844798] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: af1da677-d95a-4cec-95fa-b9208101b7dd is going to be created. [ 859.907029] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.907029] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.907029] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.907029] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.907029] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.918531] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: af1da677-d95a-4cec-95fa-b9208101b7dd in Status: IN_PROGRESS for 2s [ 860.533026] env[65337]: INFO networking_nsxv3.common.synchronization [req-a395e5c2-1997-4c50-8d91-fb0d5244b6f6 req-6e29521b-d282-46f1-a764-85a54b002cf2 tempest-ImagesTestJSON-1531636912 tempest-ImagesTestJSON-1531636912-project-member] Enqueued Resource ID: 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 with Priority: HIGHEST for action security_group_members [ 860.533728] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 with Priority: HIGHEST for action security_group_members [ 860.533939] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.534103] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.534179] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.534385] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.534541] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.534696] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.534776] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.534927] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.535019] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.535118] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7db87dc2-69af-45f1-90c2-f8a4ec96c3b7',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.961195] env[65337]: INFO networking_nsxv3.common.synchronization [None req-c3393fff-1402-4037-9c2c-920c58c22628 tempest-ImagesOneServerNegativeTestJSON-1864647261 tempest-ImagesOneServerNegativeTestJSON-1864647261-project-member] Enqueued Resource ID: 1926727b-3ca7-412e-9710-b8f816922863 with Priority: HIGHEST for action security_group_rules [ 860.961890] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1926727b-3ca7-412e-9710-b8f816922863 with Priority: HIGHEST for action security_group_rules [ 860.962155] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1926727b-3ca7-412e-9710-b8f816922863 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.962275] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1926727b-3ca7-412e-9710-b8f816922863" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.962342] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1926727b-3ca7-412e-9710-b8f816922863" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.962593] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1926727b-3ca7-412e-9710-b8f816922863" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.963131] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1926727b-3ca7-412e-9710-b8f816922863',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.037663] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7db87dc2-69af-45f1-90c2-f8a4ec96c3b7',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.055976] env[65337]: INFO networking_nsxv3.common.synchronization [None req-8eb19efa-eab8-4bad-a622-c7d05d7f977b tempest-ImagesOneServerNegativeTestJSON-1864647261 tempest-ImagesOneServerNegativeTestJSON-1864647261-project-member] Enqueued Resource ID: 1926727b-3ca7-412e-9710-b8f816922863 with Priority: HIGHEST for action security_group_rules [ 861.056384] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1926727b-3ca7-412e-9710-b8f816922863 with Priority: HIGHEST for action security_group_rules [ 861.056898] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1926727b-3ca7-412e-9710-b8f816922863 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.057010] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1926727b-3ca7-412e-9710-b8f816922863" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.486629] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.486801] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.486850] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.487066] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.487145] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.487243] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1926727b-3ca7-412e-9710-b8f816922863 already deleted. [ 861.487456] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1926727b-3ca7-412e-9710-b8f816922863" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.487611] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1926727b-3ca7-412e-9710-b8f816922863" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.487780] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1926727b-3ca7-412e-9710-b8f816922863" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.487865] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1926727b-3ca7-412e-9710-b8f816922863',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.540417] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7db87dc2-69af-45f1-90c2-f8a4ec96c3b7',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.802713] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e889ce7-965a-4de0-b096-60d4e743cf8b in Status: SUCCESS [ 861.803350] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.931821] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: af1da677-d95a-4cec-95fa-b9208101b7dd in Status: SUCCESS [ 861.932046] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.007923] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.008079] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.008420] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.008420] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.009138] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.009297] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1926727b-3ca7-412e-9710-b8f816922863 already deleted. [ 862.009398] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1926727b-3ca7-412e-9710-b8f816922863" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.043083] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.043242] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.043313] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.043524] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.043775] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.043775] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 is going to be updated. [ 862.071599] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.071995] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.071995] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.072127] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.074345] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.081758] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 in Status: IN_PROGRESS for 2s [ 862.288690] env[65337]: INFO networking_nsxv3.common.synchronization [None req-083f868e-b711-4e08-9d41-6b3dbcbef78b None None] Enqueued Resource ID: 30ed7d09-4a78-4e50-9f58-1b86176f0e3e with Priority: HIGHEST for action port [ 862.288905] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30ed7d09-4a78-4e50-9f58-1b86176f0e3e with Priority: HIGHEST for action port [ 862.290309] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-30ed7d09-4a78-4e50-9f58-1b86176f0e3e taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.290481] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-30ed7d09-4a78-4e50-9f58-1b86176f0e3e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.290561] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-30ed7d09-4a78-4e50-9f58-1b86176f0e3e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.290831] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-30ed7d09-4a78-4e50-9f58-1b86176f0e3e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.291048] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('30ed7d09-4a78-4e50-9f58-1b86176f0e3e',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.793827] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 30ed7d09-4a78-4e50-9f58-1b86176f0e3e [ 862.794132] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.794237] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.794373] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.794492] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.794601] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.794743] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:30ed7d09-4a78-4e50-9f58-1b86176f0e3e already deleted. [ 862.794835] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-30ed7d09-4a78-4e50-9f58-1b86176f0e3e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.096092] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 in Status: SUCCESS [ 864.096539] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.254426] env[65337]: INFO networking_nsxv3.common.synchronization [req-c18b6219-ce1e-4593-ba30-52dbc833feab req-44fbb2de-d291-4506-8612-f20070377a2a tempest-ServersWithSpecificFlavorTestJSON-1708740375 tempest-ServersWithSpecificFlavorTestJSON-1708740375-project-member] Enqueued Resource ID: c26a679a-9c5d-4a72-b91b-bd7f21348ea0 with Priority: HIGHEST for action security_group_members [ 865.255014] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c26a679a-9c5d-4a72-b91b-bd7f21348ea0 with Priority: HIGHEST for action security_group_members [ 865.255796] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-c26a679a-9c5d-4a72-b91b-bd7f21348ea0 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.255796] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c26a679a-9c5d-4a72-b91b-bd7f21348ea0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.255796] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c26a679a-9c5d-4a72-b91b-bd7f21348ea0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.255796] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c26a679a-9c5d-4a72-b91b-bd7f21348ea0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.256043] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.256043] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.256043] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.256316] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.256408] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.256481] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c26a679a-9c5d-4a72-b91b-bd7f21348ea0',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.705530] env[65337]: INFO networking_nsxv3.common.synchronization [req-2bc2aee2-f4ba-4536-a2fe-b5cbdb883a80 req-cd9b8480-c7d1-4b42-8f64-9e813052964c tempest-ServerRescueTestJSON-1216775078 tempest-ServerRescueTestJSON-1216775078-project-member] Enqueued Resource ID: 85232c6c-cd42-4a15-9924-943a4e75a091 with Priority: HIGHEST for action security_group_members [ 865.706115] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85232c6c-cd42-4a15-9924-943a4e75a091 with Priority: HIGHEST for action security_group_members [ 865.706431] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-85232c6c-cd42-4a15-9924-943a4e75a091 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.706551] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85232c6c-cd42-4a15-9924-943a4e75a091" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.706619] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85232c6c-cd42-4a15-9924-943a4e75a091" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.706871] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85232c6c-cd42-4a15-9924-943a4e75a091" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.709197] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.709374] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.709442] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.710275] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.710275] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.710275] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('85232c6c-cd42-4a15-9924-943a4e75a091',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.758483] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.758483] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.758940] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.758940] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.787752] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.787752] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.787752] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.787752] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.787752] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.787752] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.787752] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c26a679a-9c5d-4a72-b91b-bd7f21348ea0 is going to be updated. [ 865.822517] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.822748] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.822748] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.823347] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.823555] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.835838] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c26a679a-9c5d-4a72-b91b-bd7f21348ea0 in Status: IN_PROGRESS for 2s [ 866.212889] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.213025] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.213101] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.213442] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.239125] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.239389] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.239519] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.239571] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.239821] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.239926] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.239926] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85232c6c-cd42-4a15-9924-943a4e75a091 is going to be updated. [ 866.269989] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.270376] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.270376] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.270505] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.270649] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.281336] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85232c6c-cd42-4a15-9924-943a4e75a091 in Status: IN_PROGRESS for 2s [ 867.846877] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c26a679a-9c5d-4a72-b91b-bd7f21348ea0 in Status: SUCCESS [ 867.847227] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c26a679a-9c5d-4a72-b91b-bd7f21348ea0 deletion is rescheduled due to dependency. [ 867.847227] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c26a679a-9c5d-4a72-b91b-bd7f21348ea0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.291782] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85232c6c-cd42-4a15-9924-943a4e75a091 in Status: SUCCESS [ 868.292104] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85232c6c-cd42-4a15-9924-943a4e75a091 deletion is rescheduled due to dependency. [ 868.292291] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85232c6c-cd42-4a15-9924-943a4e75a091" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.706788] env[65337]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 870.707029] env[65337]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 872.789461] env[65337]: INFO networking_nsxv3.common.synchronization [None req-c473a465-ebd8-4b5a-b6bc-e6c5a3adfff9 None None] Enqueued Resource ID: 9c31bcd3-d96e-4fbb-a9d5-10a22f38ea48 with Priority: HIGHEST for action port [ 872.789993] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c31bcd3-d96e-4fbb-a9d5-10a22f38ea48 with Priority: HIGHEST for action port [ 872.790446] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-9c31bcd3-d96e-4fbb-a9d5-10a22f38ea48 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.790446] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9c31bcd3-d96e-4fbb-a9d5-10a22f38ea48" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.791075] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9c31bcd3-d96e-4fbb-a9d5-10a22f38ea48" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.791075] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9c31bcd3-d96e-4fbb-a9d5-10a22f38ea48" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.791075] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9c31bcd3-d96e-4fbb-a9d5-10a22f38ea48',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.293459] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9c31bcd3-d96e-4fbb-a9d5-10a22f38ea48 [ 873.293685] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.293841] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.293931] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.294127] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.294229] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.294327] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9c31bcd3-d96e-4fbb-a9d5-10a22f38ea48 already deleted. [ 873.294406] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9c31bcd3-d96e-4fbb-a9d5-10a22f38ea48" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.399312] env[65337]: INFO networking_nsxv3.common.synchronization [None req-58976474-07ab-43eb-99dd-6d40ddb628b7 tempest-ServerActionsV293TestJSON-1489208508 tempest-ServerActionsV293TestJSON-1489208508-project-member] Enqueued Resource ID: 287fa792-d512-4fba-b686-899daae58d0e with Priority: HIGHEST for action security_group_rules [ 873.399958] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 287fa792-d512-4fba-b686-899daae58d0e with Priority: HIGHEST for action security_group_rules [ 873.400229] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-287fa792-d512-4fba-b686-899daae58d0e taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.400396] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-287fa792-d512-4fba-b686-899daae58d0e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.400442] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-287fa792-d512-4fba-b686-899daae58d0e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.400660] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-287fa792-d512-4fba-b686-899daae58d0e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.400743] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('287fa792-d512-4fba-b686-899daae58d0e',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.523602] env[65337]: INFO networking_nsxv3.common.synchronization [None req-f9f9f840-211f-410c-8539-fdaa05ee83d4 tempest-ServerActionsV293TestJSON-1489208508 tempest-ServerActionsV293TestJSON-1489208508-project-member] Enqueued Resource ID: 287fa792-d512-4fba-b686-899daae58d0e with Priority: HIGHEST for action security_group_rules [ 873.524326] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 287fa792-d512-4fba-b686-899daae58d0e with Priority: HIGHEST for action security_group_rules [ 873.524794] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-287fa792-d512-4fba-b686-899daae58d0e taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.524916] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-287fa792-d512-4fba-b686-899daae58d0e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.935049] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.935049] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.935049] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.935049] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.935049] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.935049] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 287fa792-d512-4fba-b686-899daae58d0e already deleted. [ 873.935049] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-287fa792-d512-4fba-b686-899daae58d0e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.935049] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-287fa792-d512-4fba-b686-899daae58d0e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.935049] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-287fa792-d512-4fba-b686-899daae58d0e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.935049] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('287fa792-d512-4fba-b686-899daae58d0e',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.461394] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.461394] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.461394] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.461394] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.461394] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.461394] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 287fa792-d512-4fba-b686-899daae58d0e already deleted. [ 874.461394] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-287fa792-d512-4fba-b686-899daae58d0e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.392161] env[65337]: INFO networking_nsxv3.common.synchronization [None req-fe6172d5-13a6-4754-999c-d9abbef0586c None None] Enqueued Resource ID: 19626769-6560-47b8-93b9-91aad2ed3d32 with Priority: HIGHEST for action port [ 875.392786] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19626769-6560-47b8-93b9-91aad2ed3d32 with Priority: HIGHEST for action port [ 875.393159] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-19626769-6560-47b8-93b9-91aad2ed3d32 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.393300] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-19626769-6560-47b8-93b9-91aad2ed3d32" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.393410] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-19626769-6560-47b8-93b9-91aad2ed3d32" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.393670] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-19626769-6560-47b8-93b9-91aad2ed3d32" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.393769] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('19626769-6560-47b8-93b9-91aad2ed3d32',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.896043] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 19626769-6560-47b8-93b9-91aad2ed3d32 [ 875.896707] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.896863] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.896863] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.897233] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.897233] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.897332] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:19626769-6560-47b8-93b9-91aad2ed3d32 already deleted. [ 875.897466] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-19626769-6560-47b8-93b9-91aad2ed3d32" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.119124] env[65337]: INFO networking_nsxv3.common.synchronization [req-1409c4b9-61da-4831-b02b-43b6ae75d55b req-a77c0c9c-b78f-4cec-b865-fed7a37e0379 tempest-AttachInterfacesTestJSON-1783062477 tempest-AttachInterfacesTestJSON-1783062477-project-member] Enqueued Resource ID: d72090eb-ca70-4a65-8186-a5f4b40ed4cd with Priority: HIGHEST for action security_group_members [ 877.119452] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d72090eb-ca70-4a65-8186-a5f4b40ed4cd with Priority: HIGHEST for action security_group_members [ 877.119889] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-d72090eb-ca70-4a65-8186-a5f4b40ed4cd taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.119889] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d72090eb-ca70-4a65-8186-a5f4b40ed4cd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.120084] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d72090eb-ca70-4a65-8186-a5f4b40ed4cd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.122346] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d72090eb-ca70-4a65-8186-a5f4b40ed4cd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.123262] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.123262] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.123262] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.123262] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.123262] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.123262] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d72090eb-ca70-4a65-8186-a5f4b40ed4cd',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.454697] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock network-250 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.454995] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "network-250" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.455140] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "network-250" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.455408] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "network-250" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.455676] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.455898] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.455980] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.456373] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.456542] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.456833] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 877.456963] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 877.457292] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 877.457292] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 877.457360] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 877.457465] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 877.457600] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 877.479287] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 877.479560] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 877.479707] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 877.479741] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "network-250" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.480063] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock port-ff23a0ce-5a8f-479c-82fd-d46045c58e89 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.480238] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "port-ff23a0ce-5a8f-479c-82fd-d46045c58e89" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.480452] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "port-ff23a0ce-5a8f-479c-82fd-d46045c58e89" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.480679] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "port-ff23a0ce-5a8f-479c-82fd-d46045c58e89" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.480815] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ff23a0ce-5a8f-479c-82fd-d46045c58e89',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.625627] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.625833] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.625926] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.626159] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.626252] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.626465] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.626558] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.626617] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.626820] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.626908] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.626995] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d72090eb-ca70-4a65-8186-a5f4b40ed4cd already deleted. [ 877.627169] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d72090eb-ca70-4a65-8186-a5f4b40ed4cd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.983268] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.983535] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.983691] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.983990] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.984198] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.984373] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Segment Port ff23a0ce-5a8f-479c-82fd-d46045c58e89 not found, creating... [ 877.984677] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.984885] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.984998] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.985270] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.985451] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.985775] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.986068] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.986303] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.986551] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.986716] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.986889] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Resource: SegmentPort with ID: ff23a0ce-5a8f-479c-82fd-d46045c58e89 is going to be created. [ 878.006843] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.007122] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.011073] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.011073] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.011073] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.011073] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "port-ff23a0ce-5a8f-479c-82fd-d46045c58e89" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.565025] env[65337]: INFO networking_nsxv3.common.synchronization [None req-fa04eb6c-560c-4a6a-bcb7-6a0e662d6b55 None None] Enqueued Resource ID: dd2ddaa6-7b8e-4078-93e6-c9e8bffef36a with Priority: HIGHEST for action port [ 878.565025] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd2ddaa6-7b8e-4078-93e6-c9e8bffef36a with Priority: HIGHEST for action port [ 878.565025] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-dd2ddaa6-7b8e-4078-93e6-c9e8bffef36a taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.565025] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dd2ddaa6-7b8e-4078-93e6-c9e8bffef36a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.565025] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dd2ddaa6-7b8e-4078-93e6-c9e8bffef36a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.565025] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dd2ddaa6-7b8e-4078-93e6-c9e8bffef36a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.565025] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dd2ddaa6-7b8e-4078-93e6-c9e8bffef36a',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.714364] env[65337]: INFO networking_nsxv3.common.synchronization [req-1409c4b9-61da-4831-b02b-43b6ae75d55b req-cac58526-5f9b-47a8-993c-0965ba5d4750 service nova] Enqueued Resource ID: d72090eb-ca70-4a65-8186-a5f4b40ed4cd with Priority: HIGHEST for action security_group_rules [ 878.716149] env[65337]: INFO networking_nsxv3.common.synchronization [req-1409c4b9-61da-4831-b02b-43b6ae75d55b req-cac58526-5f9b-47a8-993c-0965ba5d4750 service nova] Enqueued Resource ID: d72090eb-ca70-4a65-8186-a5f4b40ed4cd with Priority: HIGHEST for action security_group_members [ 878.716149] env[65337]: INFO networking_nsxv3.common.synchronization [req-1409c4b9-61da-4831-b02b-43b6ae75d55b req-cac58526-5f9b-47a8-993c-0965ba5d4750 service nova] Enqueued Resource ID: ff23a0ce-5a8f-479c-82fd-d46045c58e89 with Priority: HIGHEST for action port [ 878.716149] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d72090eb-ca70-4a65-8186-a5f4b40ed4cd with Priority: HIGHEST for action security_group_rules [ 878.716149] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d72090eb-ca70-4a65-8186-a5f4b40ed4cd with Priority: HIGHEST for action security_group_members [ 878.716149] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff23a0ce-5a8f-479c-82fd-d46045c58e89 with Priority: HIGHEST for action port [ 878.716850] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d72090eb-ca70-4a65-8186-a5f4b40ed4cd taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.717133] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d72090eb-ca70-4a65-8186-a5f4b40ed4cd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.717323] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d72090eb-ca70-4a65-8186-a5f4b40ed4cd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.717623] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d72090eb-ca70-4a65-8186-a5f4b40ed4cd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.717808] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d72090eb-ca70-4a65-8186-a5f4b40ed4cd',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.718859] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-d72090eb-ca70-4a65-8186-a5f4b40ed4cd taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.721149] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d72090eb-ca70-4a65-8186-a5f4b40ed4cd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.721149] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d72090eb-ca70-4a65-8186-a5f4b40ed4cd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.721149] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d72090eb-ca70-4a65-8186-a5f4b40ed4cd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.721149] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.721149] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.721149] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.721149] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.721149] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.721149] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d72090eb-ca70-4a65-8186-a5f4b40ed4cd',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.721149] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-ff23a0ce-5a8f-479c-82fd-d46045c58e89 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.721659] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ff23a0ce-5a8f-479c-82fd-d46045c58e89" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.721830] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ff23a0ce-5a8f-479c-82fd-d46045c58e89" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.722100] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ff23a0ce-5a8f-479c-82fd-d46045c58e89" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.722289] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ff23a0ce-5a8f-479c-82fd-d46045c58e89',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.068438] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dd2ddaa6-7b8e-4078-93e6-c9e8bffef36a [ 879.068610] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.068754] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.068831] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.069118] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.069147] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.069268] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dd2ddaa6-7b8e-4078-93e6-c9e8bffef36a already deleted. [ 879.069367] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dd2ddaa6-7b8e-4078-93e6-c9e8bffef36a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.224621] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d72090eb-ca70-4a65-8186-a5f4b40ed4cd',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.225767] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-d72090eb-ca70-4a65-8186-a5f4b40ed4cd taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.225926] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d72090eb-ca70-4a65-8186-a5f4b40ed4cd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.226271] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ff23a0ce-5a8f-479c-82fd-d46045c58e89 with status ACTIVE [ 879.226271] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.227480] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.227480] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.227480] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.227480] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.227616] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.228599] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.228599] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.228599] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.228599] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.228599] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.228599] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.228599] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.228599] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.228599] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.229056] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ff23a0ce-5a8f-479c-82fd-d46045c58e89 is going to be updated. [ 879.252027] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.252027] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.252027] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.252284] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.252284] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.252395] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ff23a0ce-5a8f-479c-82fd-d46045c58e89" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.731445] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d72090eb-ca70-4a65-8186-a5f4b40ed4cd',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.233469] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.233625] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.233685] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.233894] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.233984] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.234095] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d72090eb-ca70-4a65-8186-a5f4b40ed4cd is going to be created. [ 880.268414] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.268414] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.268414] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.268414] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.268414] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.283929] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d72090eb-ca70-4a65-8186-a5f4b40ed4cd in Status: UNINITIALIZED for 2s [ 880.746028] env[65337]: INFO networking_nsxv3.common.synchronization [None req-667c9d58-4bac-42d2-a288-0e99618c7c64 None None] Enqueued Resource ID: 3b07642f-ead9-4c6d-b0be-4ff5bb2be6a2 with Priority: HIGHEST for action port [ 880.746888] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b07642f-ead9-4c6d-b0be-4ff5bb2be6a2 with Priority: HIGHEST for action port [ 880.747273] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-3b07642f-ead9-4c6d-b0be-4ff5bb2be6a2 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.747513] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3b07642f-ead9-4c6d-b0be-4ff5bb2be6a2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.747513] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3b07642f-ead9-4c6d-b0be-4ff5bb2be6a2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.747735] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3b07642f-ead9-4c6d-b0be-4ff5bb2be6a2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.747822] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3b07642f-ead9-4c6d-b0be-4ff5bb2be6a2',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.249959] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3b07642f-ead9-4c6d-b0be-4ff5bb2be6a2 [ 881.250336] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.250478] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.250587] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.250781] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.250921] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.251053] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3b07642f-ead9-4c6d-b0be-4ff5bb2be6a2 already deleted. [ 881.251164] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3b07642f-ead9-4c6d-b0be-4ff5bb2be6a2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.295830] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d72090eb-ca70-4a65-8186-a5f4b40ed4cd in Status: SUCCESS [ 882.296139] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d72090eb-ca70-4a65-8186-a5f4b40ed4cd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.296267] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d72090eb-ca70-4a65-8186-a5f4b40ed4cd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.296476] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d72090eb-ca70-4a65-8186-a5f4b40ed4cd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.296663] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.296778] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.296842] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.299728] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.299728] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.299846] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d72090eb-ca70-4a65-8186-a5f4b40ed4cd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.299846] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d72090eb-ca70-4a65-8186-a5f4b40ed4cd',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.803320] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d72090eb-ca70-4a65-8186-a5f4b40ed4cd',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.252185] env[65337]: INFO networking_nsxv3.common.synchronization [req-71347567-1148-43c8-8749-9b10ce01fd68 req-09b6a8f3-8e3a-408a-8529-ab571ed7d328 tempest-ListServerFiltersTestJSON-497303335 tempest-ListServerFiltersTestJSON-497303335-project-member] Enqueued Resource ID: c5bec24d-89af-4b5e-920b-dcaae02501f0 with Priority: HIGHEST for action security_group_members [ 883.252731] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5bec24d-89af-4b5e-920b-dcaae02501f0 with Priority: HIGHEST for action security_group_members [ 883.253754] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5bec24d-89af-4b5e-920b-dcaae02501f0 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.253899] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5bec24d-89af-4b5e-920b-dcaae02501f0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.253970] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5bec24d-89af-4b5e-920b-dcaae02501f0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.254277] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5bec24d-89af-4b5e-920b-dcaae02501f0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.254558] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.254767] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.254897] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.255138] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.255229] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.255325] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c5bec24d-89af-4b5e-920b-dcaae02501f0',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.309415] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d72090eb-ca70-4a65-8186-a5f4b40ed4cd: rpc.has_security_group_logging(os_id): False [ 883.329213] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.329331] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.329331] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.329525] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.331033] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.331033] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.331033] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.331033] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.331033] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.331033] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.331033] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d72090eb-ca70-4a65-8186-a5f4b40ed4cd is going to be created. [ 883.401949] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.402114] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.402175] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.402381] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.402563] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.414721] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d72090eb-ca70-4a65-8186-a5f4b40ed4cd in Status: IN_PROGRESS for 2s [ 883.633802] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock network-527 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.634029] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "network-527" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.634152] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "network-527" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.634535] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "network-527" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.634852] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.636746] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.636980] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.637317] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.637526] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.637782] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 883.637900] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 883.638020] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 883.638138] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 883.638248] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 883.638353] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 883.638486] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 883.662064] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 883.662298] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 883.662485] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 883.662787] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "network-527" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.663165] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock port-9a911d5e-187f-46c6-bd29-73745925dc48 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.663357] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "port-9a911d5e-187f-46c6-bd29-73745925dc48" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.663481] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "port-9a911d5e-187f-46c6-bd29-73745925dc48" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.663843] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "port-9a911d5e-187f-46c6-bd29-73745925dc48" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.663987] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9a911d5e-187f-46c6-bd29-73745925dc48',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.757750] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.757945] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.758039] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.758256] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.758344] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.758536] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.758633] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.758691] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.758837] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.758912] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.758996] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5bec24d-89af-4b5e-920b-dcaae02501f0 already deleted. [ 883.759088] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5bec24d-89af-4b5e-920b-dcaae02501f0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.172058] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.172058] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.172058] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.172058] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.172058] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.172058] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Segment Port 9a911d5e-187f-46c6-bd29-73745925dc48 not found, creating... [ 884.172058] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.172058] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.172058] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.172058] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.172058] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.172533] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.172533] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.173029] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.175183] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.175183] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.175183] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Resource: SegmentPort with ID: 9a911d5e-187f-46c6-bd29-73745925dc48 is going to be created. [ 884.196685] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.196900] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.197133] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.197418] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.197647] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.197862] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "port-9a911d5e-187f-46c6-bd29-73745925dc48" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.917267] env[65337]: INFO networking_nsxv3.common.synchronization [req-71347567-1148-43c8-8749-9b10ce01fd68 req-f25b4792-b6ad-44f2-8dd0-89cd77858ac3 service nova] Enqueued Resource ID: c5bec24d-89af-4b5e-920b-dcaae02501f0 with Priority: HIGHEST for action security_group_rules [ 884.917522] env[65337]: INFO networking_nsxv3.common.synchronization [req-71347567-1148-43c8-8749-9b10ce01fd68 req-f25b4792-b6ad-44f2-8dd0-89cd77858ac3 service nova] Enqueued Resource ID: c5bec24d-89af-4b5e-920b-dcaae02501f0 with Priority: HIGHEST for action security_group_members [ 884.917622] env[65337]: INFO networking_nsxv3.common.synchronization [req-71347567-1148-43c8-8749-9b10ce01fd68 req-f25b4792-b6ad-44f2-8dd0-89cd77858ac3 service nova] Enqueued Resource ID: 9a911d5e-187f-46c6-bd29-73745925dc48 with Priority: HIGHEST for action port [ 884.918173] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5bec24d-89af-4b5e-920b-dcaae02501f0 with Priority: HIGHEST for action security_group_rules [ 884.918454] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5bec24d-89af-4b5e-920b-dcaae02501f0 with Priority: HIGHEST for action security_group_members [ 884.918454] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a911d5e-187f-46c6-bd29-73745925dc48 with Priority: HIGHEST for action port [ 884.918754] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c5bec24d-89af-4b5e-920b-dcaae02501f0 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.918862] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c5bec24d-89af-4b5e-920b-dcaae02501f0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.918953] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c5bec24d-89af-4b5e-920b-dcaae02501f0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.919538] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c5bec24d-89af-4b5e-920b-dcaae02501f0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.919687] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c5bec24d-89af-4b5e-920b-dcaae02501f0',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.920676] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5bec24d-89af-4b5e-920b-dcaae02501f0 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.920896] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5bec24d-89af-4b5e-920b-dcaae02501f0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.921057] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5bec24d-89af-4b5e-920b-dcaae02501f0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.921293] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5bec24d-89af-4b5e-920b-dcaae02501f0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.921532] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.921678] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.924362] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.924575] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.924664] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.924840] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c5bec24d-89af-4b5e-920b-dcaae02501f0',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.926107] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-9a911d5e-187f-46c6-bd29-73745925dc48 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.926247] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9a911d5e-187f-46c6-bd29-73745925dc48" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.926701] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9a911d5e-187f-46c6-bd29-73745925dc48" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.926701] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9a911d5e-187f-46c6-bd29-73745925dc48" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.926799] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9a911d5e-187f-46c6-bd29-73745925dc48',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.428498] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d72090eb-ca70-4a65-8186-a5f4b40ed4cd in Status: SUCCESS [ 885.428746] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d72090eb-ca70-4a65-8186-a5f4b40ed4cd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.429226] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c5bec24d-89af-4b5e-920b-dcaae02501f0',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.431218] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5bec24d-89af-4b5e-920b-dcaae02501f0 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.431366] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5bec24d-89af-4b5e-920b-dcaae02501f0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.431535] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9a911d5e-187f-46c6-bd29-73745925dc48 with status ACTIVE [ 885.431710] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.432074] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.432074] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.432074] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.432203] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.433282] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.433282] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.433282] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.433282] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.433282] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.433282] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.433282] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.433282] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.433282] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.433611] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.433611] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9a911d5e-187f-46c6-bd29-73745925dc48 is going to be updated. [ 885.460860] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.461038] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.461790] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.461790] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.461790] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.461790] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9a911d5e-187f-46c6-bd29-73745925dc48" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.932206] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c5bec24d-89af-4b5e-920b-dcaae02501f0',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.437778] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.437905] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.437905] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.438174] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.438480] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.438480] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5bec24d-89af-4b5e-920b-dcaae02501f0 is going to be created. [ 886.475773] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.476324] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.476324] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.476324] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.476516] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.490041] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5bec24d-89af-4b5e-920b-dcaae02501f0 in Status: UNINITIALIZED for 2s [ 888.501059] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5bec24d-89af-4b5e-920b-dcaae02501f0 in Status: SUCCESS [ 888.501387] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5bec24d-89af-4b5e-920b-dcaae02501f0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.501462] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5bec24d-89af-4b5e-920b-dcaae02501f0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.502027] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5bec24d-89af-4b5e-920b-dcaae02501f0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.502027] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.502027] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.502227] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.502227] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.502300] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.502482] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5bec24d-89af-4b5e-920b-dcaae02501f0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.502482] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c5bec24d-89af-4b5e-920b-dcaae02501f0',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.533717] env[65337]: INFO networking_nsxv3.common.synchronization [req-2459cd34-a18f-47de-a233-dd5bab89e3b8 req-96d16b84-9d92-459e-a7b6-b56c8ef9fd5d tempest-ServerActionsTestOtherB-648353996 tempest-ServerActionsTestOtherB-648353996-project-member] Enqueued Resource ID: d4ff60fe-3407-42aa-b33c-6254779ad495 with Priority: HIGHEST for action security_group_members [ 888.534713] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4ff60fe-3407-42aa-b33c-6254779ad495 with Priority: HIGHEST for action security_group_members [ 888.534713] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4ff60fe-3407-42aa-b33c-6254779ad495 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.534713] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4ff60fe-3407-42aa-b33c-6254779ad495" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.534893] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4ff60fe-3407-42aa-b33c-6254779ad495" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.535488] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4ff60fe-3407-42aa-b33c-6254779ad495" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.535488] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.535488] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.535488] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.535488] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.535693] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.535693] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d4ff60fe-3407-42aa-b33c-6254779ad495',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.004700] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5bec24d-89af-4b5e-920b-dcaae02501f0 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.005262] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5bec24d-89af-4b5e-920b-dcaae02501f0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.005337] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5bec24d-89af-4b5e-920b-dcaae02501f0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.005559] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5bec24d-89af-4b5e-920b-dcaae02501f0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.006774] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.010022] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.010022] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.010022] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.010022] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.010022] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5bec24d-89af-4b5e-920b-dcaae02501f0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.010022] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5bec24d-89af-4b5e-920b-dcaae02501f0 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.010022] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5bec24d-89af-4b5e-920b-dcaae02501f0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.010022] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5bec24d-89af-4b5e-920b-dcaae02501f0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.010022] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5bec24d-89af-4b5e-920b-dcaae02501f0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.010022] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.010022] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.010022] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.010022] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.010022] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.010022] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5bec24d-89af-4b5e-920b-dcaae02501f0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.010022] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c5bec24d-89af-4b5e-920b-dcaae02501f0',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.038096] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.038488] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.038488] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.039651] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.066376] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.066757] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.066910] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.066977] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.068161] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.068263] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.068423] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d4ff60fe-3407-42aa-b33c-6254779ad495 is going to be updated. [ 889.102127] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.102327] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.102404] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.102610] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.102758] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.116418] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4ff60fe-3407-42aa-b33c-6254779ad495 in Status: IN_PROGRESS for 2s [ 889.516038] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c5bec24d-89af-4b5e-920b-dcaae02501f0: rpc.has_security_group_logging(os_id): False [ 889.543382] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.543570] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.543570] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.548020] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.548020] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.548020] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.548020] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.548020] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.548020] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.548020] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.548020] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.548020] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.548020] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.548020] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.548020] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.548020] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.548020] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.548762] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.548762] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.548762] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.548762] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c5bec24d-89af-4b5e-920b-dcaae02501f0 is going to be created. [ 889.623986] env[65337]: INFO networking_nsxv3.common.synchronization [None req-434fed88-2211-477d-96b9-0ef9c9af427a None None] Enqueued Resource ID: 1245375a-2bde-4b35-a627-6b71126213ad with Priority: HIGHEST for action port [ 889.624640] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1245375a-2bde-4b35-a627-6b71126213ad with Priority: HIGHEST for action port [ 889.625292] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-1245375a-2bde-4b35-a627-6b71126213ad taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.625292] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1245375a-2bde-4b35-a627-6b71126213ad" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.625292] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1245375a-2bde-4b35-a627-6b71126213ad" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.625495] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1245375a-2bde-4b35-a627-6b71126213ad" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.625581] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1245375a-2bde-4b35-a627-6b71126213ad',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.663806] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.664014] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.664014] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.664233] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.664403] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.677037] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c5bec24d-89af-4b5e-920b-dcaae02501f0 in Status: IN_PROGRESS for 2s [ 890.127913] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1245375a-2bde-4b35-a627-6b71126213ad [ 890.128174] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.128309] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.128377] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.128600] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.128688] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.128781] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1245375a-2bde-4b35-a627-6b71126213ad already deleted. [ 890.128863] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1245375a-2bde-4b35-a627-6b71126213ad" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.142049] env[65337]: INFO networking_nsxv3.common.synchronization [None req-40ed00e6-61fa-4db6-804d-fc165f1d8ea3 tempest-ServerActionsTestJSON-704073373 tempest-ServerActionsTestJSON-704073373-project-member] Enqueued Resource ID: 5f51b41c-ca91-45cf-92a6-17398a529bbb with Priority: HIGHEST for action security_group_rules [ 890.142672] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f51b41c-ca91-45cf-92a6-17398a529bbb with Priority: HIGHEST for action security_group_rules [ 890.143263] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5f51b41c-ca91-45cf-92a6-17398a529bbb taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.143389] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5f51b41c-ca91-45cf-92a6-17398a529bbb" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.143455] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5f51b41c-ca91-45cf-92a6-17398a529bbb" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.143698] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5f51b41c-ca91-45cf-92a6-17398a529bbb" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.143780] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5f51b41c-ca91-45cf-92a6-17398a529bbb',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.158977] env[65337]: INFO networking_nsxv3.common.synchronization [req-fd3cd906-b39d-40a3-b864-482631adf291 req-7ba2924f-9f80-431c-9d1e-0ffed1c3b31a tempest-ListServerFiltersTestJSON-497303335 tempest-ListServerFiltersTestJSON-497303335-project-member] Enqueued Resource ID: c5bec24d-89af-4b5e-920b-dcaae02501f0 with Priority: HIGHEST for action security_group_members [ 890.159633] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5bec24d-89af-4b5e-920b-dcaae02501f0 with Priority: HIGHEST for action security_group_members [ 890.160392] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5bec24d-89af-4b5e-920b-dcaae02501f0 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.160392] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5bec24d-89af-4b5e-920b-dcaae02501f0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.160392] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5bec24d-89af-4b5e-920b-dcaae02501f0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.160548] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5bec24d-89af-4b5e-920b-dcaae02501f0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.160548] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.160644] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.160695] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.160823] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.160901] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.160987] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c5bec24d-89af-4b5e-920b-dcaae02501f0',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.248456] env[65337]: INFO networking_nsxv3.common.synchronization [None req-e37a4016-0ec1-4ba1-9b54-b7bcb5dbf805 tempest-ServerActionsTestJSON-704073373 tempest-ServerActionsTestJSON-704073373-project-member] Enqueued Resource ID: 5f51b41c-ca91-45cf-92a6-17398a529bbb with Priority: HIGHEST for action security_group_rules [ 890.251778] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f51b41c-ca91-45cf-92a6-17398a529bbb with Priority: HIGHEST for action security_group_rules [ 890.252768] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5f51b41c-ca91-45cf-92a6-17398a529bbb taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.253459] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5f51b41c-ca91-45cf-92a6-17398a529bbb" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.625898] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock network-527 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.626440] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "network-527" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.626440] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "network-527" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.626755] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "network-527" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.630094] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.630882] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.630882] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.631055] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.631157] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.631468] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 890.631632] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 890.631806] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 890.633940] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 890.634035] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 890.634135] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 890.634282] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 890.662952] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 890.663169] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 890.663307] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 890.663500] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "network-527" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.663870] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock port-62930862-fa95-42cf-ba04-3d1032a15898 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.664081] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "port-62930862-fa95-42cf-ba04-3d1032a15898" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.664217] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "port-62930862-fa95-42cf-ba04-3d1032a15898" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.664569] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "port-62930862-fa95-42cf-ba04-3d1032a15898" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.664714] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('62930862-fa95-42cf-ba04-3d1032a15898',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.665836] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c5bec24d-89af-4b5e-920b-dcaae02501f0',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.668187] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.668187] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.668187] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.668187] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.668187] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.668187] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5f51b41c-ca91-45cf-92a6-17398a529bbb already deleted. [ 890.668187] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5f51b41c-ca91-45cf-92a6-17398a529bbb" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.668829] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5f51b41c-ca91-45cf-92a6-17398a529bbb" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.669924] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5f51b41c-ca91-45cf-92a6-17398a529bbb" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.670056] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5f51b41c-ca91-45cf-92a6-17398a529bbb',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.127089] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4ff60fe-3407-42aa-b33c-6254779ad495 in Status: SUCCESS [ 891.127089] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d4ff60fe-3407-42aa-b33c-6254779ad495 deletion is rescheduled due to dependency. [ 891.127089] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4ff60fe-3407-42aa-b33c-6254779ad495" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.171150] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.171150] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.171150] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.171359] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.171399] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.172040] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Segment Port 62930862-fa95-42cf-ba04-3d1032a15898 not found, creating... [ 891.172040] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.172040] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.172255] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.172401] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.172596] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.172956] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.173157] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.174880] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.174880] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.174880] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.174880] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Resource: SegmentPort with ID: 62930862-fa95-42cf-ba04-3d1032a15898 is going to be created. [ 891.175163] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c5bec24d-89af-4b5e-920b-dcaae02501f0',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.194547] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.194979] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.194979] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.194979] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.195122] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.195192] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5f51b41c-ca91-45cf-92a6-17398a529bbb already deleted. [ 891.195251] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5f51b41c-ca91-45cf-92a6-17398a529bbb" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.199177] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.202386] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.202386] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.202386] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.202386] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.202386] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "port-62930862-fa95-42cf-ba04-3d1032a15898" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.677998] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.680256] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.680366] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.680647] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.680723] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.680795] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5bec24d-89af-4b5e-920b-dcaae02501f0 is going to be updated. [ 891.696536] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c5bec24d-89af-4b5e-920b-dcaae02501f0 in Status: SUCCESS [ 891.696536] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c5bec24d-89af-4b5e-920b-dcaae02501f0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.714176] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.714320] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.714416] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.714633] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.714773] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.724188] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5bec24d-89af-4b5e-920b-dcaae02501f0 in Status: IN_PROGRESS for 2s [ 891.884499] env[65337]: INFO networking_nsxv3.common.synchronization [req-fd3cd906-b39d-40a3-b864-482631adf291 req-32bfff2a-5a9d-49b1-9c98-2a856d86e5dd service nova] Enqueued Resource ID: c5bec24d-89af-4b5e-920b-dcaae02501f0 with Priority: HIGHEST for action security_group_rules [ 891.884499] env[65337]: INFO networking_nsxv3.common.synchronization [req-fd3cd906-b39d-40a3-b864-482631adf291 req-32bfff2a-5a9d-49b1-9c98-2a856d86e5dd service nova] Enqueued Resource ID: c5bec24d-89af-4b5e-920b-dcaae02501f0 with Priority: HIGHEST for action security_group_members [ 891.884499] env[65337]: INFO networking_nsxv3.common.synchronization [req-fd3cd906-b39d-40a3-b864-482631adf291 req-32bfff2a-5a9d-49b1-9c98-2a856d86e5dd service nova] Enqueued Resource ID: 62930862-fa95-42cf-ba04-3d1032a15898 with Priority: HIGHEST for action port [ 891.884499] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5bec24d-89af-4b5e-920b-dcaae02501f0 with Priority: HIGHEST for action security_group_rules [ 891.884499] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5bec24d-89af-4b5e-920b-dcaae02501f0 with Priority: HIGHEST for action security_group_members [ 891.884499] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62930862-fa95-42cf-ba04-3d1032a15898 with Priority: HIGHEST for action port [ 891.884730] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c5bec24d-89af-4b5e-920b-dcaae02501f0 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.885026] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c5bec24d-89af-4b5e-920b-dcaae02501f0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.885026] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c5bec24d-89af-4b5e-920b-dcaae02501f0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.885315] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c5bec24d-89af-4b5e-920b-dcaae02501f0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.885315] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c5bec24d-89af-4b5e-920b-dcaae02501f0',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.886240] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5bec24d-89af-4b5e-920b-dcaae02501f0 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.886356] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5bec24d-89af-4b5e-920b-dcaae02501f0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.886557] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-62930862-fa95-42cf-ba04-3d1032a15898 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.886673] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-62930862-fa95-42cf-ba04-3d1032a15898" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.886743] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-62930862-fa95-42cf-ba04-3d1032a15898" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.886914] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-62930862-fa95-42cf-ba04-3d1032a15898" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.887016] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('62930862-fa95-42cf-ba04-3d1032a15898',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.214603] env[65337]: INFO networking_nsxv3.common.synchronization [None req-93e66e95-22a0-41d9-af88-69cd40147055 None None] Enqueued Resource ID: 83df1261-6655-459f-912d-b2fde21b310c with Priority: HIGHEST for action port [ 892.215496] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83df1261-6655-459f-912d-b2fde21b310c with Priority: HIGHEST for action port [ 892.215667] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-83df1261-6655-459f-912d-b2fde21b310c taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.216215] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-83df1261-6655-459f-912d-b2fde21b310c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.216215] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-83df1261-6655-459f-912d-b2fde21b310c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.216303] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-83df1261-6655-459f-912d-b2fde21b310c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.216391] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('83df1261-6655-459f-912d-b2fde21b310c',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.388468] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5bec24d-89af-4b5e-920b-dcaae02501f0 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.388604] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5bec24d-89af-4b5e-920b-dcaae02501f0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.389985] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 62930862-fa95-42cf-ba04-3d1032a15898 with status ACTIVE [ 892.390181] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.391228] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.391228] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.391228] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.391228] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.391228] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.391228] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.391228] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.391228] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.391465] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.391465] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.391528] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.391554] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.391697] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.391764] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.391864] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 62930862-fa95-42cf-ba04-3d1032a15898 is going to be updated. [ 892.413382] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.413833] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.413833] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.413931] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.414239] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.415323] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-62930862-fa95-42cf-ba04-3d1032a15898" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.718514] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 83df1261-6655-459f-912d-b2fde21b310c [ 892.718783] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.718866] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.718934] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.719174] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.719268] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.719365] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:83df1261-6655-459f-912d-b2fde21b310c already deleted. [ 892.719447] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-83df1261-6655-459f-912d-b2fde21b310c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.932673] env[65337]: INFO networking_nsxv3.common.synchronization [req-c89d1e59-cd7d-4c00-907a-7de6a1e64f01 req-4506ad2b-f8f5-4226-8b34-feb1b3580120 tempest-ListServerFiltersTestJSON-497303335 tempest-ListServerFiltersTestJSON-497303335-project-member] Enqueued Resource ID: c5bec24d-89af-4b5e-920b-dcaae02501f0 with Priority: HIGHEST for action security_group_members [ 892.933376] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5bec24d-89af-4b5e-920b-dcaae02501f0 with Priority: HIGHEST for action security_group_members [ 892.933697] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5bec24d-89af-4b5e-920b-dcaae02501f0 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.933803] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5bec24d-89af-4b5e-920b-dcaae02501f0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.264706] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock network-527 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.264968] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "network-527" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.265149] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "network-527" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.265473] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "network-527" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.265793] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.265981] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.266153] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.266366] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.266509] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.266739] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 893.266861] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 893.266970] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 893.267090] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 893.267202] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 893.267329] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 893.267482] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 893.286180] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 893.286419] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 893.286563] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 893.286735] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "network-527" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.287056] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock port-21ff9c7a-e51a-448c-ba70-7e84e1e09c95 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.287253] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "port-21ff9c7a-e51a-448c-ba70-7e84e1e09c95" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.287380] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "port-21ff9c7a-e51a-448c-ba70-7e84e1e09c95" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.287693] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "port-21ff9c7a-e51a-448c-ba70-7e84e1e09c95" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.287831] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('21ff9c7a-e51a-448c-ba70-7e84e1e09c95',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.736046] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5bec24d-89af-4b5e-920b-dcaae02501f0 in Status: SUCCESS [ 893.736377] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5bec24d-89af-4b5e-920b-dcaae02501f0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.737698] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5bec24d-89af-4b5e-920b-dcaae02501f0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.737698] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5bec24d-89af-4b5e-920b-dcaae02501f0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.737698] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.737698] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.737698] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.737698] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.737698] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.737698] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c5bec24d-89af-4b5e-920b-dcaae02501f0',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.790689] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.791031] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.791217] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.791569] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.791874] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.792011] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Segment Port 21ff9c7a-e51a-448c-ba70-7e84e1e09c95 not found, creating... [ 893.792706] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.793027] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.793188] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.793467] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.793637] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.794056] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.794231] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.794360] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.794613] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.794719] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.794999] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Resource: SegmentPort with ID: 21ff9c7a-e51a-448c-ba70-7e84e1e09c95 is going to be created. [ 893.817372] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.817607] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.817738] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.818066] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.818332] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.818600] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "port-21ff9c7a-e51a-448c-ba70-7e84e1e09c95" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.241266] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c5bec24d-89af-4b5e-920b-dcaae02501f0',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.508999] env[65337]: INFO networking_nsxv3.common.synchronization [req-c89d1e59-cd7d-4c00-907a-7de6a1e64f01 req-a85ed82c-3dc9-412b-b62f-373becc539ea service nova] Enqueued Resource ID: c5bec24d-89af-4b5e-920b-dcaae02501f0 with Priority: HIGHEST for action security_group_rules [ 894.509207] env[65337]: INFO networking_nsxv3.common.synchronization [req-c89d1e59-cd7d-4c00-907a-7de6a1e64f01 req-a85ed82c-3dc9-412b-b62f-373becc539ea service nova] Enqueued Resource ID: c5bec24d-89af-4b5e-920b-dcaae02501f0 with Priority: HIGHEST for action security_group_members [ 894.509343] env[65337]: INFO networking_nsxv3.common.synchronization [req-c89d1e59-cd7d-4c00-907a-7de6a1e64f01 req-a85ed82c-3dc9-412b-b62f-373becc539ea service nova] Enqueued Resource ID: 21ff9c7a-e51a-448c-ba70-7e84e1e09c95 with Priority: HIGHEST for action port [ 894.509854] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5bec24d-89af-4b5e-920b-dcaae02501f0 with Priority: HIGHEST for action security_group_rules [ 894.509993] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5bec24d-89af-4b5e-920b-dcaae02501f0 with Priority: HIGHEST for action security_group_members [ 894.511975] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21ff9c7a-e51a-448c-ba70-7e84e1e09c95 with Priority: HIGHEST for action port [ 894.512305] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c5bec24d-89af-4b5e-920b-dcaae02501f0 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.512406] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c5bec24d-89af-4b5e-920b-dcaae02501f0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.512608] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5bec24d-89af-4b5e-920b-dcaae02501f0 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.512688] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5bec24d-89af-4b5e-920b-dcaae02501f0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.513671] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-21ff9c7a-e51a-448c-ba70-7e84e1e09c95 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.514466] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-21ff9c7a-e51a-448c-ba70-7e84e1e09c95" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.514466] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-21ff9c7a-e51a-448c-ba70-7e84e1e09c95" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.514466] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-21ff9c7a-e51a-448c-ba70-7e84e1e09c95" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.514466] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('21ff9c7a-e51a-448c-ba70-7e84e1e09c95',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.746019] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c5bec24d-89af-4b5e-920b-dcaae02501f0',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.016322] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 21ff9c7a-e51a-448c-ba70-7e84e1e09c95 with status ACTIVE [ 895.016624] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.016784] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.016875] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.017145] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.017261] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.017468] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.017566] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.017628] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.017785] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.017864] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.018111] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.018214] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.018275] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.018418] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.018500] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.018585] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 21ff9c7a-e51a-448c-ba70-7e84e1e09c95 is going to be updated. [ 895.042589] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.042768] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.042863] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.043121] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.043424] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.043626] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-21ff9c7a-e51a-448c-ba70-7e84e1e09c95" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.247578] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.248603] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.248603] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.248603] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.248603] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.248603] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5bec24d-89af-4b5e-920b-dcaae02501f0 is going to be updated. [ 895.276548] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.276696] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.276769] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.276985] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.277225] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.289288] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5bec24d-89af-4b5e-920b-dcaae02501f0 in Status: IN_PROGRESS for 2s [ 897.305078] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5bec24d-89af-4b5e-920b-dcaae02501f0 in Status: SUCCESS [ 897.305078] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5bec24d-89af-4b5e-920b-dcaae02501f0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.305535] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5bec24d-89af-4b5e-920b-dcaae02501f0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.305535] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5bec24d-89af-4b5e-920b-dcaae02501f0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.305643] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.305765] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.305826] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.306044] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.306134] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.306236] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5bec24d-89af-4b5e-920b-dcaae02501f0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.306320] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c5bec24d-89af-4b5e-920b-dcaae02501f0',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.307955] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5bec24d-89af-4b5e-920b-dcaae02501f0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.309159] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5bec24d-89af-4b5e-920b-dcaae02501f0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.309159] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.309159] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.309159] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.309159] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.309159] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.309159] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c5bec24d-89af-4b5e-920b-dcaae02501f0',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.812045] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5bec24d-89af-4b5e-920b-dcaae02501f0 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.812045] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5bec24d-89af-4b5e-920b-dcaae02501f0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.813101] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c5bec24d-89af-4b5e-920b-dcaae02501f0',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.316094] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c5bec24d-89af-4b5e-920b-dcaae02501f0',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.818345] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.818479] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.818479] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.818804] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.818932] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.819069] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5bec24d-89af-4b5e-920b-dcaae02501f0 is going to be updated. [ 898.854366] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.854532] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.854588] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.854856] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.855058] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.865930] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5bec24d-89af-4b5e-920b-dcaae02501f0 in Status: IN_PROGRESS for 2s [ 899.513047] env[65337]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 899.514022] env[65337]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=4 [ 900.715677] env[65337]: INFO networking_nsxv3.common.synchronization [None req-002589f5-d0c9-4b62-bc12-7650f5151e0d tempest-ServerActionsTestOtherA-84911055 tempest-ServerActionsTestOtherA-84911055-project-member] Enqueued Resource ID: e27d75d1-404e-406a-a69e-4560bd02b4cc with Priority: HIGHEST for action security_group_rules [ 900.716338] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e27d75d1-404e-406a-a69e-4560bd02b4cc with Priority: HIGHEST for action security_group_rules [ 900.716661] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e27d75d1-404e-406a-a69e-4560bd02b4cc taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.716817] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e27d75d1-404e-406a-a69e-4560bd02b4cc" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.716872] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e27d75d1-404e-406a-a69e-4560bd02b4cc" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.717177] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e27d75d1-404e-406a-a69e-4560bd02b4cc" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.717298] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e27d75d1-404e-406a-a69e-4560bd02b4cc',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.824000] env[65337]: INFO networking_nsxv3.common.synchronization [None req-7e49b7a6-ee8d-4410-9098-b05cc2ff6d67 tempest-ServerActionsTestOtherA-84911055 tempest-ServerActionsTestOtherA-84911055-project-member] Enqueued Resource ID: e27d75d1-404e-406a-a69e-4560bd02b4cc with Priority: HIGHEST for action security_group_rules [ 900.824000] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e27d75d1-404e-406a-a69e-4560bd02b4cc with Priority: HIGHEST for action security_group_rules [ 900.824000] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e27d75d1-404e-406a-a69e-4560bd02b4cc taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.824000] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e27d75d1-404e-406a-a69e-4560bd02b4cc" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.883367] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5bec24d-89af-4b5e-920b-dcaae02501f0 in Status: SUCCESS [ 900.883681] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5bec24d-89af-4b5e-920b-dcaae02501f0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.883925] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5bec24d-89af-4b5e-920b-dcaae02501f0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.884225] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5bec24d-89af-4b5e-920b-dcaae02501f0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.884455] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.887486] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.887486] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.887486] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.887486] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.887486] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c5bec24d-89af-4b5e-920b-dcaae02501f0',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.241272] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.241461] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.241513] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.241843] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.241941] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.242048] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e27d75d1-404e-406a-a69e-4560bd02b4cc already deleted. [ 901.242164] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e27d75d1-404e-406a-a69e-4560bd02b4cc" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.242274] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e27d75d1-404e-406a-a69e-4560bd02b4cc" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.242434] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e27d75d1-404e-406a-a69e-4560bd02b4cc" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.242515] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e27d75d1-404e-406a-a69e-4560bd02b4cc',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.387500] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c5bec24d-89af-4b5e-920b-dcaae02501f0',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.500352] env[65337]: INFO networking_nsxv3.common.synchronization [req-afa86f9b-7cbd-4186-b72d-64928c86293e req-89da180f-a66b-458d-8f83-8636c50c650b tempest-SecurityGroupsTestJSON-920822125 tempest-SecurityGroupsTestJSON-920822125-project-member] Enqueued Resource ID: 5289c470-2cbe-4957-bd37-f39138ab0a31 with Priority: HIGHEST for action security_group_members [ 901.500502] env[65337]: INFO networking_nsxv3.common.synchronization [req-afa86f9b-7cbd-4186-b72d-64928c86293e req-89da180f-a66b-458d-8f83-8636c50c650b tempest-SecurityGroupsTestJSON-920822125 tempest-SecurityGroupsTestJSON-920822125-project-member] Enqueued Resource ID: 755f030a-6e7c-43ec-adb9-cb4c270ad532 with Priority: HIGHEST for action security_group_members [ 901.500637] env[65337]: INFO networking_nsxv3.common.synchronization [req-afa86f9b-7cbd-4186-b72d-64928c86293e req-89da180f-a66b-458d-8f83-8636c50c650b tempest-SecurityGroupsTestJSON-920822125 tempest-SecurityGroupsTestJSON-920822125-project-member] Enqueued Resource ID: ebb204e1-ff28-4709-a165-ad95f8c27d8b with Priority: HIGHEST for action security_group_members [ 901.501223] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5289c470-2cbe-4957-bd37-f39138ab0a31 with Priority: HIGHEST for action security_group_members [ 901.501359] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 755f030a-6e7c-43ec-adb9-cb4c270ad532 with Priority: HIGHEST for action security_group_members [ 901.501452] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebb204e1-ff28-4709-a165-ad95f8c27d8b with Priority: HIGHEST for action security_group_members [ 901.502179] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-5289c470-2cbe-4957-bd37-f39138ab0a31 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.502325] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5289c470-2cbe-4957-bd37-f39138ab0a31" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.502395] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5289c470-2cbe-4957-bd37-f39138ab0a31" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.502604] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5289c470-2cbe-4957-bd37-f39138ab0a31" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.502761] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.502864] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.502927] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.503090] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.503175] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.503272] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5289c470-2cbe-4957-bd37-f39138ab0a31',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.504187] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-755f030a-6e7c-43ec-adb9-cb4c270ad532 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.504292] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.504364] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.504514] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.504659] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.504659] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.504659] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.504659] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.507326] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.507445] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('755f030a-6e7c-43ec-adb9-cb4c270ad532',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.508420] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebb204e1-ff28-4709-a165-ad95f8c27d8b taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.508532] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebb204e1-ff28-4709-a165-ad95f8c27d8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.508599] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebb204e1-ff28-4709-a165-ad95f8c27d8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.508766] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebb204e1-ff28-4709-a165-ad95f8c27d8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.508912] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.509036] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.509111] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.509262] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.509344] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.509439] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ebb204e1-ff28-4709-a165-ad95f8c27d8b',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.767133] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.767411] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.767411] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.767542] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.767665] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.767764] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e27d75d1-404e-406a-a69e-4560bd02b4cc already deleted. [ 901.767847] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e27d75d1-404e-406a-a69e-4560bd02b4cc" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.892252] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c5bec24d-89af-4b5e-920b-dcaae02501f0',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.011057] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.011235] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.011303] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.011534] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.012841] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.012955] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.013219] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.013266] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.035041] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.035183] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.035322] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.035380] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.035585] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.035668] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.036249] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5289c470-2cbe-4957-bd37-f39138ab0a31 is going to be updated. [ 902.036893] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.036969] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.061238] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.061570] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.061761] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.061793] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.062048] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.062150] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.062248] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ebb204e1-ff28-4709-a165-ad95f8c27d8b is going to be updated. [ 902.063318] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.063571] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.063600] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.063770] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.063876] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.063941] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.064098] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.064174] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.064258] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 755f030a-6e7c-43ec-adb9-cb4c270ad532 is going to be updated. [ 902.067328] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.067448] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.067507] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.067669] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.067801] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.080737] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5289c470-2cbe-4957-bd37-f39138ab0a31 in Status: IN_PROGRESS for 2s [ 902.101853] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.101853] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.101853] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.101853] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.102038] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.104365] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.104473] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.104473] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.104771] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.104771] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.117576] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebb204e1-ff28-4709-a165-ad95f8c27d8b in Status: IN_PROGRESS for 2s [ 902.118255] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 755f030a-6e7c-43ec-adb9-cb4c270ad532 in Status: IN_PROGRESS for 2s [ 902.396801] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.396957] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.397037] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.397305] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.397441] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.397560] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5bec24d-89af-4b5e-920b-dcaae02501f0 is going to be updated. [ 902.429029] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.429190] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.430036] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.430036] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.430036] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.439413] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5bec24d-89af-4b5e-920b-dcaae02501f0 in Status: IN_PROGRESS for 2s [ 904.090416] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5289c470-2cbe-4957-bd37-f39138ab0a31 in Status: SUCCESS [ 904.090724] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5289c470-2cbe-4957-bd37-f39138ab0a31 deletion is rescheduled due to dependency. [ 904.090724] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5289c470-2cbe-4957-bd37-f39138ab0a31" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.127717] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebb204e1-ff28-4709-a165-ad95f8c27d8b in Status: SUCCESS [ 904.127934] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ebb204e1-ff28-4709-a165-ad95f8c27d8b deletion is rescheduled due to dependency. [ 904.128070] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebb204e1-ff28-4709-a165-ad95f8c27d8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.128843] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 755f030a-6e7c-43ec-adb9-cb4c270ad532 in Status: SUCCESS [ 904.128989] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 755f030a-6e7c-43ec-adb9-cb4c270ad532 deletion is rescheduled due to dependency. [ 904.129109] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.451495] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5bec24d-89af-4b5e-920b-dcaae02501f0 in Status: SUCCESS [ 904.451678] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5bec24d-89af-4b5e-920b-dcaae02501f0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.451952] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5bec24d-89af-4b5e-920b-dcaae02501f0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.452134] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5bec24d-89af-4b5e-920b-dcaae02501f0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.452260] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.452635] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.452635] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.452635] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.452763] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.452763] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5bec24d-89af-4b5e-920b-dcaae02501f0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.452919] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5bec24d-89af-4b5e-920b-dcaae02501f0 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.453372] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5bec24d-89af-4b5e-920b-dcaae02501f0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.453372] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5bec24d-89af-4b5e-920b-dcaae02501f0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.453372] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5bec24d-89af-4b5e-920b-dcaae02501f0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.453372] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.453532] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.453532] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.453700] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.453700] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.453791] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5bec24d-89af-4b5e-920b-dcaae02501f0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.454025] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c5bec24d-89af-4b5e-920b-dcaae02501f0',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.958363] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c5bec24d-89af-4b5e-920b-dcaae02501f0: rpc.has_security_group_logging(os_id): False [ 904.977238] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.977451] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.977451] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.977706] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.977832] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.977938] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.978050] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.978115] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.978264] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.978320] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.978514] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.978635] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.978697] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.978909] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.978963] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.979130] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.979223] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.979279] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.979413] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.979485] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.979564] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c5bec24d-89af-4b5e-920b-dcaae02501f0 is going to be updated. [ 905.044012] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.044952] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.044952] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.044952] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.044952] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.061649] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c5bec24d-89af-4b5e-920b-dcaae02501f0 in Status: IN_PROGRESS for 2s [ 905.259641] env[65337]: INFO networking_nsxv3.common.synchronization [req-5fe0bf24-05f1-44f5-8de8-719f8b60d31e req-715b8ec5-3078-4aba-b600-d56836bc2c04 tempest-MigrationsAdminTest-367558634 tempest-MigrationsAdminTest-367558634-project-member] Enqueued Resource ID: d8e2d833-6da9-488a-a2b1-f410f4205706 with Priority: HIGHEST for action security_group_members [ 905.260254] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8e2d833-6da9-488a-a2b1-f410f4205706 with Priority: HIGHEST for action security_group_members [ 905.260571] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8e2d833-6da9-488a-a2b1-f410f4205706 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.260689] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8e2d833-6da9-488a-a2b1-f410f4205706" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.260755] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8e2d833-6da9-488a-a2b1-f410f4205706" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.260957] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8e2d833-6da9-488a-a2b1-f410f4205706" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.261134] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.261225] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.261285] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.261425] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.261735] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.261879] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d8e2d833-6da9-488a-a2b1-f410f4205706',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.628503] env[65337]: INFO networking_nsxv3.common.synchronization [None req-a1769da0-0253-4472-9dc9-23853dec58a1 None None] Enqueued Resource ID: 527021f2-81be-42d2-af7e-f6f05452f798 with Priority: HIGHEST for action port [ 905.630268] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 527021f2-81be-42d2-af7e-f6f05452f798 with Priority: HIGHEST for action port [ 905.630708] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-527021f2-81be-42d2-af7e-f6f05452f798 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.630877] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-527021f2-81be-42d2-af7e-f6f05452f798" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.630981] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-527021f2-81be-42d2-af7e-f6f05452f798" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.631674] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-527021f2-81be-42d2-af7e-f6f05452f798" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.631674] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('527021f2-81be-42d2-af7e-f6f05452f798',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.766081] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.766081] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.766081] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.766081] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.787351] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.787351] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.787351] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.789236] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.789236] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.789236] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.789236] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8e2d833-6da9-488a-a2b1-f410f4205706 is going to be updated. [ 905.820732] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.820884] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.821043] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.821183] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.821636] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.831135] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8e2d833-6da9-488a-a2b1-f410f4205706 in Status: IN_PROGRESS for 2s [ 906.137818] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 527021f2-81be-42d2-af7e-f6f05452f798 [ 906.138077] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.138216] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.138281] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.139116] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.139116] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.139116] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:527021f2-81be-42d2-af7e-f6f05452f798 already deleted. [ 906.139116] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-527021f2-81be-42d2-af7e-f6f05452f798" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.084483] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c5bec24d-89af-4b5e-920b-dcaae02501f0 in Status: SUCCESS [ 907.085078] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c5bec24d-89af-4b5e-920b-dcaae02501f0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.085476] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c5bec24d-89af-4b5e-920b-dcaae02501f0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.085476] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c5bec24d-89af-4b5e-920b-dcaae02501f0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.085613] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c5bec24d-89af-4b5e-920b-dcaae02501f0',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.551483] env[65337]: INFO networking_nsxv3.common.synchronization [None req-86ec4358-99a1-43ca-8021-ae56e0cd3c6d None None] Enqueued Resource ID: e7e36ade-185d-4779-ba85-24a4c9178108 with Priority: HIGHEST for action port [ 907.553594] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7e36ade-185d-4779-ba85-24a4c9178108 with Priority: HIGHEST for action port [ 907.553986] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-e7e36ade-185d-4779-ba85-24a4c9178108 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.554126] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e7e36ade-185d-4779-ba85-24a4c9178108" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.554190] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e7e36ade-185d-4779-ba85-24a4c9178108" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.554433] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e7e36ade-185d-4779-ba85-24a4c9178108" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.554513] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e7e36ade-185d-4779-ba85-24a4c9178108',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.589251] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5bec24d-89af-4b5e-920b-dcaae02501f0 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.589251] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5bec24d-89af-4b5e-920b-dcaae02501f0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.589251] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5bec24d-89af-4b5e-920b-dcaae02501f0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.589251] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5bec24d-89af-4b5e-920b-dcaae02501f0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.589251] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.590571] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.590571] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.590693] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.590902] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.590902] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5bec24d-89af-4b5e-920b-dcaae02501f0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.590975] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c5bec24d-89af-4b5e-920b-dcaae02501f0',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.843452] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8e2d833-6da9-488a-a2b1-f410f4205706 in Status: SUCCESS [ 907.843636] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8e2d833-6da9-488a-a2b1-f410f4205706 deletion is rescheduled due to dependency. [ 907.847025] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8e2d833-6da9-488a-a2b1-f410f4205706" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.017322] env[65337]: INFO networking_nsxv3.common.synchronization [None req-0273de2e-855b-4cf7-a631-4c0ec34c5f82 None None] Enqueued Resource ID: 0e94d8bc-3fe9-4dbf-b50d-e42177537e35 with Priority: HIGHEST for action port [ 908.017980] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e94d8bc-3fe9-4dbf-b50d-e42177537e35 with Priority: HIGHEST for action port [ 908.018266] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-0e94d8bc-3fe9-4dbf-b50d-e42177537e35 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.018401] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0e94d8bc-3fe9-4dbf-b50d-e42177537e35" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.018466] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0e94d8bc-3fe9-4dbf-b50d-e42177537e35" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.018771] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0e94d8bc-3fe9-4dbf-b50d-e42177537e35" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.018859] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0e94d8bc-3fe9-4dbf-b50d-e42177537e35',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.056396] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e7e36ade-185d-4779-ba85-24a4c9178108 [ 908.056647] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.056792] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.056860] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.057097] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.057223] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.057514] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e7e36ade-185d-4779-ba85-24a4c9178108 already deleted. [ 908.057651] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e7e36ade-185d-4779-ba85-24a4c9178108" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.094089] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5bec24d-89af-4b5e-920b-dcaae02501f0 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.094089] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5bec24d-89af-4b5e-920b-dcaae02501f0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.094089] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5bec24d-89af-4b5e-920b-dcaae02501f0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.094089] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5bec24d-89af-4b5e-920b-dcaae02501f0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.094552] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.094552] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.094762] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.094762] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.094838] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.094914] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5bec24d-89af-4b5e-920b-dcaae02501f0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.095079] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5bec24d-89af-4b5e-920b-dcaae02501f0 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.095179] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5bec24d-89af-4b5e-920b-dcaae02501f0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.095251] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5bec24d-89af-4b5e-920b-dcaae02501f0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.095382] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5bec24d-89af-4b5e-920b-dcaae02501f0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.095521] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.095610] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.095669] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.095818] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.095874] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.095958] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5bec24d-89af-4b5e-920b-dcaae02501f0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.096331] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c5bec24d-89af-4b5e-920b-dcaae02501f0',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.523150] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0e94d8bc-3fe9-4dbf-b50d-e42177537e35 [ 908.523150] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.523150] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.523150] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.523150] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.523150] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.523150] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0e94d8bc-3fe9-4dbf-b50d-e42177537e35 already deleted. [ 908.523150] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0e94d8bc-3fe9-4dbf-b50d-e42177537e35" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.601085] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c5bec24d-89af-4b5e-920b-dcaae02501f0: rpc.has_security_group_logging(os_id): False [ 908.620911] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.620911] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.620911] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.620911] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.620911] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.620911] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.620911] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.620911] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.620911] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.620911] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.620911] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.620911] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.620911] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.620911] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.620911] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.621580] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.621580] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.621580] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.621580] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.621580] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.621580] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c5bec24d-89af-4b5e-920b-dcaae02501f0 is going to be updated. [ 908.707255] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.707456] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.707548] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.707782] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.707945] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.735414] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c5bec24d-89af-4b5e-920b-dcaae02501f0 in Status: IN_PROGRESS for 2s [ 910.048044] env[65337]: INFO networking_nsxv3.common.synchronization [None req-30011c7e-74b0-400f-a23d-33f3e4cc367f None None] Enqueued Resource ID: 6bb97b03-535a-426b-88da-9f187b74d6bb with Priority: HIGHEST for action port [ 910.048592] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6bb97b03-535a-426b-88da-9f187b74d6bb with Priority: HIGHEST for action port [ 910.048894] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-6bb97b03-535a-426b-88da-9f187b74d6bb taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.049026] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6bb97b03-535a-426b-88da-9f187b74d6bb" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.049096] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6bb97b03-535a-426b-88da-9f187b74d6bb" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.049372] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6bb97b03-535a-426b-88da-9f187b74d6bb" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.049444] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6bb97b03-535a-426b-88da-9f187b74d6bb',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.555075] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6bb97b03-535a-426b-88da-9f187b74d6bb [ 910.555446] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.555746] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.555962] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.556752] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.556752] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.556752] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6bb97b03-535a-426b-88da-9f187b74d6bb already deleted. [ 910.556752] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6bb97b03-535a-426b-88da-9f187b74d6bb" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.755979] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c5bec24d-89af-4b5e-920b-dcaae02501f0 in Status: SUCCESS [ 910.755979] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c5bec24d-89af-4b5e-920b-dcaae02501f0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.052088] env[65337]: INFO networking_nsxv3.common.synchronization [req-9fd34895-3344-45af-9298-7eab513b108f req-bc74b54a-ca80-41a3-a865-4988676b9071 tempest-ServersAdminTestJSON-283641549 tempest-ServersAdminTestJSON-283641549-project-member] Enqueued Resource ID: 9e889ce7-965a-4de0-b096-60d4e743cf8b with Priority: HIGHEST for action security_group_members [ 911.052933] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e889ce7-965a-4de0-b096-60d4e743cf8b with Priority: HIGHEST for action security_group_members [ 911.053085] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e889ce7-965a-4de0-b096-60d4e743cf8b taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.053205] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.053270] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.053465] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.053617] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.053761] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.053761] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.053903] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.053997] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.054121] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e889ce7-965a-4de0-b096-60d4e743cf8b',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.557524] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9e889ce7-965a-4de0-b096-60d4e743cf8b',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.061056] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9e889ce7-965a-4de0-b096-60d4e743cf8b',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.563855] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.564032] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.564102] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.564320] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.564422] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.564558] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e889ce7-965a-4de0-b096-60d4e743cf8b is going to be updated. [ 912.594111] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.594296] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.594350] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.594756] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.594756] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.607029] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e889ce7-965a-4de0-b096-60d4e743cf8b in Status: IN_PROGRESS for 2s [ 914.617741] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e889ce7-965a-4de0-b096-60d4e743cf8b in Status: SUCCESS [ 914.617992] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.257340] env[65337]: INFO networking_nsxv3.common.synchronization [req-2dc7b359-76d6-40fd-9023-a7d73b4b14b4 req-7b3acf19-ac73-4148-a99f-f8c0002d8bbb tempest-ImagesOneServerNegativeTestJSON-1864647261 tempest-ImagesOneServerNegativeTestJSON-1864647261-project-member] Enqueued Resource ID: 12a747a0-2898-4059-bada-c453c5c41052 with Priority: HIGHEST for action security_group_members [ 915.257938] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12a747a0-2898-4059-bada-c453c5c41052 with Priority: HIGHEST for action security_group_members [ 915.258598] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-12a747a0-2898-4059-bada-c453c5c41052 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.258718] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12a747a0-2898-4059-bada-c453c5c41052" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.258793] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12a747a0-2898-4059-bada-c453c5c41052" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.259095] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12a747a0-2898-4059-bada-c453c5c41052" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.259308] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.259426] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.259490] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.259692] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.259800] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.259927] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('12a747a0-2898-4059-bada-c453c5c41052',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.659583] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock network-514 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.659920] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "network-514" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.659920] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "network-514" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.660227] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "network-514" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.660663] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.660850] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.661252] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.661323] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.661427] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.661732] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 915.661914] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 915.662121] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 915.663077] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 915.663077] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 915.663077] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 915.663077] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 915.670947] env[65337]: INFO networking_nsxv3.common.synchronization [req-4ff108e6-1f4c-4077-ba4b-df5ae22aaf97 req-65aeebc7-efab-4a90-835d-e9735c960184 tempest-ImagesTestJSON-1531636912 tempest-ImagesTestJSON-1531636912-project-member] Enqueued Resource ID: 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 with Priority: HIGHEST for action security_group_members [ 915.672041] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 with Priority: HIGHEST for action security_group_members [ 915.672041] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.672199] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.672199] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.672391] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.672562] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.672867] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.672867] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.672867] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.673039] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.673077] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7db87dc2-69af-45f1-90c2-f8a4ec96c3b7',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.692185] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 915.692185] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 915.692185] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 915.692185] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "network-514" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.692185] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock port-11ceeac4-8cdd-4fa2-ae02-5d3be8ec7a89 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.692185] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "port-11ceeac4-8cdd-4fa2-ae02-5d3be8ec7a89" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.692185] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "port-11ceeac4-8cdd-4fa2-ae02-5d3be8ec7a89" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.692185] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "port-11ceeac4-8cdd-4fa2-ae02-5d3be8ec7a89" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.692533] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('11ceeac4-8cdd-4fa2-ae02-5d3be8ec7a89',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.762044] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.762212] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.762265] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.762497] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.782356] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.782574] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.782687] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.782745] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.782972] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.783068] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.783155] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12a747a0-2898-4059-bada-c453c5c41052 is going to be updated. [ 915.809540] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.809696] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.809740] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.809922] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.810069] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.820919] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12a747a0-2898-4059-bada-c453c5c41052 in Status: IN_PROGRESS for 2s [ 916.176141] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.177416] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.177416] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.177416] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.177416] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.177416] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.177416] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.177416] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.177416] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.177416] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.177416] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 is going to be updated. [ 916.195640] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.195745] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.195934] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.196101] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.197148] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.197148] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Segment Port 11ceeac4-8cdd-4fa2-ae02-5d3be8ec7a89 not found, creating... [ 916.197148] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.197148] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.197148] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.197148] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.197492] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.198166] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.198387] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.198513] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.198777] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.198920] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.199283] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Resource: SegmentPort with ID: 11ceeac4-8cdd-4fa2-ae02-5d3be8ec7a89 is going to be created. [ 916.206157] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.206347] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.206347] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.206782] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.206782] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.216827] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 in Status: IN_PROGRESS for 2s [ 916.221656] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.221843] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.221891] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.222173] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.222408] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.222622] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "port-11ceeac4-8cdd-4fa2-ae02-5d3be8ec7a89" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.968119] env[65337]: INFO networking_nsxv3.common.synchronization [req-2dc7b359-76d6-40fd-9023-a7d73b4b14b4 req-20b7aaf1-87ed-4502-aa75-cac9dbedc553 service nova] Enqueued Resource ID: 12a747a0-2898-4059-bada-c453c5c41052 with Priority: HIGHEST for action security_group_rules [ 916.968394] env[65337]: INFO networking_nsxv3.common.synchronization [req-2dc7b359-76d6-40fd-9023-a7d73b4b14b4 req-20b7aaf1-87ed-4502-aa75-cac9dbedc553 service nova] Enqueued Resource ID: 12a747a0-2898-4059-bada-c453c5c41052 with Priority: HIGHEST for action security_group_members [ 916.968589] env[65337]: INFO networking_nsxv3.common.synchronization [req-2dc7b359-76d6-40fd-9023-a7d73b4b14b4 req-20b7aaf1-87ed-4502-aa75-cac9dbedc553 service nova] Enqueued Resource ID: 11ceeac4-8cdd-4fa2-ae02-5d3be8ec7a89 with Priority: HIGHEST for action port [ 916.969267] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12a747a0-2898-4059-bada-c453c5c41052 with Priority: HIGHEST for action security_group_rules [ 916.969510] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12a747a0-2898-4059-bada-c453c5c41052 with Priority: HIGHEST for action security_group_members [ 916.969657] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11ceeac4-8cdd-4fa2-ae02-5d3be8ec7a89 with Priority: HIGHEST for action port [ 916.970063] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-12a747a0-2898-4059-bada-c453c5c41052 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.970234] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-12a747a0-2898-4059-bada-c453c5c41052" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.970436] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-12a747a0-2898-4059-bada-c453c5c41052" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.970713] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-12a747a0-2898-4059-bada-c453c5c41052" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.970821] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('12a747a0-2898-4059-bada-c453c5c41052',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.972970] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-12a747a0-2898-4059-bada-c453c5c41052 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.973110] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12a747a0-2898-4059-bada-c453c5c41052" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.973397] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-11ceeac4-8cdd-4fa2-ae02-5d3be8ec7a89 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.973579] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-11ceeac4-8cdd-4fa2-ae02-5d3be8ec7a89" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.974420] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-11ceeac4-8cdd-4fa2-ae02-5d3be8ec7a89" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.974420] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-11ceeac4-8cdd-4fa2-ae02-5d3be8ec7a89" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.974420] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('11ceeac4-8cdd-4fa2-ae02-5d3be8ec7a89',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.474239] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-12a747a0-2898-4059-bada-c453c5c41052 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.474423] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12a747a0-2898-4059-bada-c453c5c41052" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.475810] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 11ceeac4-8cdd-4fa2-ae02-5d3be8ec7a89 with status ACTIVE [ 917.476071] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.476367] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.476367] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.476571] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.476662] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.476920] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.477046] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.477046] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.477203] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.477296] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.477504] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.477628] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.477713] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.477872] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.477966] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.478067] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 11ceeac4-8cdd-4fa2-ae02-5d3be8ec7a89 is going to be updated. [ 917.501782] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.501945] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.502015] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.502240] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.502383] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.502545] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-11ceeac4-8cdd-4fa2-ae02-5d3be8ec7a89" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.831314] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12a747a0-2898-4059-bada-c453c5c41052 in Status: SUCCESS [ 917.831523] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12a747a0-2898-4059-bada-c453c5c41052 deletion is rescheduled due to dependency. [ 917.831653] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12a747a0-2898-4059-bada-c453c5c41052" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.831914] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12a747a0-2898-4059-bada-c453c5c41052" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.832139] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12a747a0-2898-4059-bada-c453c5c41052" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.832329] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.832485] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.832524] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.832641] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.833318] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.833318] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('12a747a0-2898-4059-bada-c453c5c41052',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.229077] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 in Status: SUCCESS [ 918.229077] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 deletion is rescheduled due to dependency. [ 918.229077] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.335545] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('12a747a0-2898-4059-bada-c453c5c41052',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.837723] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('12a747a0-2898-4059-bada-c453c5c41052',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.339973] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.340323] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.340323] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.340438] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.341034] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.341034] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12a747a0-2898-4059-bada-c453c5c41052 is going to be updated. [ 919.369456] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.369639] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.369703] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.369862] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.370016] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.378596] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12a747a0-2898-4059-bada-c453c5c41052 in Status: IN_PROGRESS for 2s [ 921.389859] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12a747a0-2898-4059-bada-c453c5c41052 in Status: SUCCESS [ 921.390099] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12a747a0-2898-4059-bada-c453c5c41052" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.390280] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12a747a0-2898-4059-bada-c453c5c41052" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.390568] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12a747a0-2898-4059-bada-c453c5c41052" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.390763] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.390880] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.390946] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.391109] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.391192] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.391290] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12a747a0-2898-4059-bada-c453c5c41052" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.392033] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('12a747a0-2898-4059-bada-c453c5c41052',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.893528] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-12a747a0-2898-4059-bada-c453c5c41052 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.893728] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12a747a0-2898-4059-bada-c453c5c41052" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.893767] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12a747a0-2898-4059-bada-c453c5c41052" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.894811] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12a747a0-2898-4059-bada-c453c5c41052" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.894811] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.894811] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.894811] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.894811] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.894811] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.894811] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12a747a0-2898-4059-bada-c453c5c41052" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.894811] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-12a747a0-2898-4059-bada-c453c5c41052 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.895217] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12a747a0-2898-4059-bada-c453c5c41052" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.895217] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12a747a0-2898-4059-bada-c453c5c41052" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.895293] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12a747a0-2898-4059-bada-c453c5c41052" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.895408] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.895500] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.895615] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.895762] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.895843] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.895926] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12a747a0-2898-4059-bada-c453c5c41052" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.896047] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('12a747a0-2898-4059-bada-c453c5c41052',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.970560] env[65337]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 921.970636] env[65337]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 922.398646] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 12a747a0-2898-4059-bada-c453c5c41052: rpc.has_security_group_logging(os_id): False [ 922.418033] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.418284] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.418284] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.419024] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.419024] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.419024] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.419024] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.419024] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.419341] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.419341] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.419423] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.419551] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.419645] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.419810] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.419889] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.420095] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.420199] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.420241] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.420377] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.420449] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.420532] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 12a747a0-2898-4059-bada-c453c5c41052 is going to be updated. [ 922.481798] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.481983] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.482163] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.482378] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.482525] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.496866] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 12a747a0-2898-4059-bada-c453c5c41052 in Status: IN_PROGRESS for 2s [ 923.792895] env[65337]: INFO networking_nsxv3.common.synchronization [req-a36f394c-a3b1-4c7f-a500-18978baeb80b req-85bf360a-7c9b-4489-859e-ecd86ad6f688 tempest-AttachInterfacesTestJSON-1783062477 tempest-AttachInterfacesTestJSON-1783062477-project-member] Enqueued Resource ID: 94a13e53-dcf7-4643-ade4-8789dc9eabc4 with Priority: HIGHEST for action security_group_members [ 923.792895] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94a13e53-dcf7-4643-ade4-8789dc9eabc4 with Priority: HIGHEST for action security_group_members [ 923.794261] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-94a13e53-dcf7-4643-ade4-8789dc9eabc4 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.794751] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.794751] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.794751] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.795213] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.795213] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.795213] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.795213] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.795400] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.795509] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('94a13e53-dcf7-4643-ade4-8789dc9eabc4',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.182265] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock network-250 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.182526] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "network-250" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.182716] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "network-250" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.183107] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "network-250" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.185478] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.185693] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.185693] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.185984] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.186221] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.186514] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 924.186687] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 924.186856] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 924.187034] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 924.187301] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 924.187480] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 924.187675] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 924.208671] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 924.209301] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 924.209301] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 924.209301] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "network-250" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.209717] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock port-965a77e4-3877-46e1-b245-c293aece1750 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.209940] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "port-965a77e4-3877-46e1-b245-c293aece1750" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.210125] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "port-965a77e4-3877-46e1-b245-c293aece1750" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.210537] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "port-965a77e4-3877-46e1-b245-c293aece1750" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.210880] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('965a77e4-3877-46e1-b245-c293aece1750',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.302016] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.302016] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.302016] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.302016] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.320306] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.320574] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.320696] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.320755] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.320956] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.321049] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.321138] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 94a13e53-dcf7-4643-ade4-8789dc9eabc4 is going to be updated. [ 924.362121] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.362307] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.362381] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.362586] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.362726] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.372272] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94a13e53-dcf7-4643-ade4-8789dc9eabc4 in Status: IN_PROGRESS for 2s [ 924.514476] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 12a747a0-2898-4059-bada-c453c5c41052 in Status: SUCCESS [ 924.514871] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-12a747a0-2898-4059-bada-c453c5c41052" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.714052] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.714052] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.714052] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.714878] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.714878] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.714878] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Segment Port 965a77e4-3877-46e1-b245-c293aece1750 not found, creating... [ 924.715264] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.715495] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.715661] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.715959] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.716194] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.716619] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.716845] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.717027] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.717324] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.717508] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.717837] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Resource: SegmentPort with ID: 965a77e4-3877-46e1-b245-c293aece1750 is going to be created. [ 924.740102] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.740452] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.741264] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.741979] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.742425] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.742760] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "port-965a77e4-3877-46e1-b245-c293aece1750" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.837944] env[65337]: INFO networking_nsxv3.common.synchronization [req-34902e1c-5fbb-44a4-9d94-825a71efe402 req-98bbae62-c962-4162-b70c-8a5b4a464fb3 tempest-DeleteServersTestJSON-1654690426 tempest-DeleteServersTestJSON-1654690426-project-member] Enqueued Resource ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d with Priority: HIGHEST for action security_group_members [ 924.838409] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d with Priority: HIGHEST for action security_group_members [ 924.838930] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-161889a4-32a2-48ee-8fb7-d2a961a4b28d taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.839121] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.839340] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.839639] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.839875] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.840044] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.840123] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.840420] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.840576] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.840725] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('161889a4-32a2-48ee-8fb7-d2a961a4b28d',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.217929] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock network-211 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.218175] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "network-211" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.218302] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "network-211" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.218558] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "network-211" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.218806] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.218955] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.219098] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.219330] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.219473] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.219677] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 925.219788] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 925.219894] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 925.220010] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 925.220118] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 925.220226] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 925.220351] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 925.242363] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 925.242567] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 925.242703] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 925.242876] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "network-211" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.243220] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock port-f4222896-7a44-4575-b266-855fb3fc5ada taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.243396] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "port-f4222896-7a44-4575-b266-855fb3fc5ada" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.243509] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "port-f4222896-7a44-4575-b266-855fb3fc5ada" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.243848] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "port-f4222896-7a44-4575-b266-855fb3fc5ada" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.243995] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f4222896-7a44-4575-b266-855fb3fc5ada',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.343595] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.343772] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.343772] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.343923] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.344012] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.344237] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.344342] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.344403] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.344561] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.344640] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.344725] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d is going to be deleted. [ 925.376701] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.376860] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.376916] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.377186] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.377244] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.377345] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.445294] env[65337]: INFO networking_nsxv3.common.synchronization [req-a36f394c-a3b1-4c7f-a500-18978baeb80b req-24fef50d-6656-4057-a09d-e1e6cebb7bc5 service nova] Enqueued Resource ID: 94a13e53-dcf7-4643-ade4-8789dc9eabc4 with Priority: HIGHEST for action security_group_rules [ 925.445294] env[65337]: INFO networking_nsxv3.common.synchronization [req-a36f394c-a3b1-4c7f-a500-18978baeb80b req-24fef50d-6656-4057-a09d-e1e6cebb7bc5 service nova] Enqueued Resource ID: 94a13e53-dcf7-4643-ade4-8789dc9eabc4 with Priority: HIGHEST for action security_group_members [ 925.445294] env[65337]: INFO networking_nsxv3.common.synchronization [req-a36f394c-a3b1-4c7f-a500-18978baeb80b req-24fef50d-6656-4057-a09d-e1e6cebb7bc5 service nova] Enqueued Resource ID: 965a77e4-3877-46e1-b245-c293aece1750 with Priority: HIGHEST for action port [ 925.445294] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94a13e53-dcf7-4643-ade4-8789dc9eabc4 with Priority: HIGHEST for action security_group_rules [ 925.445294] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94a13e53-dcf7-4643-ade4-8789dc9eabc4 with Priority: HIGHEST for action security_group_members [ 925.445294] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 965a77e4-3877-46e1-b245-c293aece1750 with Priority: HIGHEST for action port [ 925.445294] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-94a13e53-dcf7-4643-ade4-8789dc9eabc4 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.445764] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.445970] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.446305] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.446564] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('94a13e53-dcf7-4643-ade4-8789dc9eabc4',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.447551] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-94a13e53-dcf7-4643-ade4-8789dc9eabc4 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.447857] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.448193] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-965a77e4-3877-46e1-b245-c293aece1750 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.450619] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-965a77e4-3877-46e1-b245-c293aece1750" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.450619] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-965a77e4-3877-46e1-b245-c293aece1750" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.450700] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-965a77e4-3877-46e1-b245-c293aece1750" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.450753] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('965a77e4-3877-46e1-b245-c293aece1750',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.748815] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.749039] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.749176] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.749461] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.749857] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.750126] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Segment Port f4222896-7a44-4575-b266-855fb3fc5ada not found, creating... [ 925.750531] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.750779] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.751182] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.751491] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.751708] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.752125] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.752357] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.752540] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.752814] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.753021] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.753242] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Resource: SegmentPort with ID: f4222896-7a44-4575-b266-855fb3fc5ada is going to be created. [ 925.786014] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.786798] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.786798] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.786798] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.787150] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.787341] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "port-f4222896-7a44-4575-b266-855fb3fc5ada" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.952836] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-94a13e53-dcf7-4643-ade4-8789dc9eabc4 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.953122] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.953293] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 965a77e4-3877-46e1-b245-c293aece1750 with status ACTIVE [ 925.953492] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.953605] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.953677] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.953927] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.954032] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.954225] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.954387] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.954473] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.954641] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.954753] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.955088] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.955350] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.955427] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.955593] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.955678] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.955766] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 965a77e4-3877-46e1-b245-c293aece1750 is going to be updated. [ 925.977776] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.977998] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.977998] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.978289] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.978459] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.978643] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-965a77e4-3877-46e1-b245-c293aece1750" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.382164] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94a13e53-dcf7-4643-ade4-8789dc9eabc4 in Status: SUCCESS [ 926.382276] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 94a13e53-dcf7-4643-ade4-8789dc9eabc4 deletion is rescheduled due to dependency. [ 926.382430] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.382628] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.382854] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.383071] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.383223] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.383286] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.383412] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.383500] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.383594] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('94a13e53-dcf7-4643-ade4-8789dc9eabc4',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.484941] env[65337]: INFO networking_nsxv3.common.synchronization [req-34902e1c-5fbb-44a4-9d94-825a71efe402 req-6e4319cc-0dae-482c-831b-3468aad6f765 service nova] Enqueued Resource ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d with Priority: HIGHEST for action security_group_rules [ 926.484941] env[65337]: INFO networking_nsxv3.common.synchronization [req-34902e1c-5fbb-44a4-9d94-825a71efe402 req-6e4319cc-0dae-482c-831b-3468aad6f765 service nova] Enqueued Resource ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d with Priority: HIGHEST for action security_group_members [ 926.484941] env[65337]: INFO networking_nsxv3.common.synchronization [req-34902e1c-5fbb-44a4-9d94-825a71efe402 req-6e4319cc-0dae-482c-831b-3468aad6f765 service nova] Enqueued Resource ID: f4222896-7a44-4575-b266-855fb3fc5ada with Priority: HIGHEST for action port [ 926.485409] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d with Priority: HIGHEST for action security_group_rules [ 926.485659] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d with Priority: HIGHEST for action security_group_members [ 926.485885] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4222896-7a44-4575-b266-855fb3fc5ada with Priority: HIGHEST for action port [ 926.489083] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-161889a4-32a2-48ee-8fb7-d2a961a4b28d taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.489083] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.489083] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.489083] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.489083] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('161889a4-32a2-48ee-8fb7-d2a961a4b28d',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.489083] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-161889a4-32a2-48ee-8fb7-d2a961a4b28d taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.489083] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.489083] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.489083] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.489083] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.489083] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.489083] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.489083] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.489083] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.489083] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('161889a4-32a2-48ee-8fb7-d2a961a4b28d',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.491554] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-f4222896-7a44-4575-b266-855fb3fc5ada taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.492101] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f4222896-7a44-4575-b266-855fb3fc5ada" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.492290] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f4222896-7a44-4575-b266-855fb3fc5ada" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.492567] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f4222896-7a44-4575-b266-855fb3fc5ada" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.494631] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f4222896-7a44-4575-b266-855fb3fc5ada',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.885647] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('94a13e53-dcf7-4643-ade4-8789dc9eabc4',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.994599] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('161889a4-32a2-48ee-8fb7-d2a961a4b28d',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.995772] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-161889a4-32a2-48ee-8fb7-d2a961a4b28d taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.995877] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.997903] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f4222896-7a44-4575-b266-855fb3fc5ada with status ACTIVE [ 926.997903] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.997903] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.997903] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.997903] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.998192] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.998192] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.998262] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.998543] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.998599] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.998640] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.998863] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.999125] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.999424] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.999621] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.999703] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.999815] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f4222896-7a44-4575-b266-855fb3fc5ada is going to be updated. [ 927.021816] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.022017] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.022061] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.022271] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.022404] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.022557] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f4222896-7a44-4575-b266-855fb3fc5ada" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.254071] env[65337]: INFO networking_nsxv3.common.synchronization [req-ffd4fe51-3ac7-4016-af2f-aaf9efc129ca req-2a95ca27-f0ca-4417-83ef-81327f9afd0f tempest-ServersTestJSON-1910122825 tempest-ServersTestJSON-1910122825-project-member] Enqueued Resource ID: af1da677-d95a-4cec-95fa-b9208101b7dd with Priority: HIGHEST for action security_group_members [ 927.254595] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af1da677-d95a-4cec-95fa-b9208101b7dd with Priority: HIGHEST for action security_group_members [ 927.254918] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-af1da677-d95a-4cec-95fa-b9208101b7dd taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.255082] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.255157] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.255351] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.255509] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.255607] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.255675] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.255797] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.255878] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.255975] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('af1da677-d95a-4cec-95fa-b9208101b7dd',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.388727] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('94a13e53-dcf7-4643-ade4-8789dc9eabc4',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.497576] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('161889a4-32a2-48ee-8fb7-d2a961a4b28d',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.546603] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock network-48 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.546859] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "network-48" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.547054] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "network-48" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.547530] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "network-48" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.547638] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.547814] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.547913] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.548207] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.548319] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.548522] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 927.548633] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 927.548740] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 927.548845] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 927.548950] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 927.549067] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 927.549200] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 927.569222] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 927.570529] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 927.570529] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 927.570529] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "network-48" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.570529] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock port-ea34178c-2bc2-4cb3-91f3-44fcc7f671bf taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.570529] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "port-ea34178c-2bc2-4cb3-91f3-44fcc7f671bf" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.570529] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "port-ea34178c-2bc2-4cb3-91f3-44fcc7f671bf" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.571358] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "port-ea34178c-2bc2-4cb3-91f3-44fcc7f671bf" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.571358] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ea34178c-2bc2-4cb3-91f3-44fcc7f671bf',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.758016] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('af1da677-d95a-4cec-95fa-b9208101b7dd',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.892754] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.893034] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.893034] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.893598] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.893598] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.893598] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 94a13e53-dcf7-4643-ade4-8789dc9eabc4 is going to be updated. [ 927.926558] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.926702] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.926738] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.926939] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.927105] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.938199] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94a13e53-dcf7-4643-ade4-8789dc9eabc4 in Status: IN_PROGRESS for 2s [ 927.999786] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.000135] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.000135] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.000250] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.000341] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.000441] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d is going to be created. [ 928.025035] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.025223] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.025352] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.025576] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.025826] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.037827] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d in Status: UNINITIALIZED for 2s [ 928.073856] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.074161] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.074324] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.074675] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.074864] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.075973] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Segment Port ea34178c-2bc2-4cb3-91f3-44fcc7f671bf not found, creating... [ 928.076158] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.076328] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.076443] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.077061] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.077061] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.077412] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.077412] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.077412] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.077595] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.077728] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.077858] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Resource: SegmentPort with ID: ea34178c-2bc2-4cb3-91f3-44fcc7f671bf is going to be created. [ 928.099752] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.100111] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.100351] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.100733] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.101086] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.101419] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "port-ea34178c-2bc2-4cb3-91f3-44fcc7f671bf" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.260464] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('af1da677-d95a-4cec-95fa-b9208101b7dd',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.763810] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.763810] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.763810] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.764910] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.764910] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.764910] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: af1da677-d95a-4cec-95fa-b9208101b7dd is going to be updated. [ 928.794249] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.794249] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.794249] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.794249] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.794568] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.804369] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af1da677-d95a-4cec-95fa-b9208101b7dd in Status: IN_PROGRESS for 2s [ 928.819369] env[65337]: INFO networking_nsxv3.common.synchronization [req-ffd4fe51-3ac7-4016-af2f-aaf9efc129ca req-e1122470-73bc-4e72-9b5d-1ba00114b772 service nova] Enqueued Resource ID: af1da677-d95a-4cec-95fa-b9208101b7dd with Priority: HIGHEST for action security_group_rules [ 928.819553] env[65337]: INFO networking_nsxv3.common.synchronization [req-ffd4fe51-3ac7-4016-af2f-aaf9efc129ca req-e1122470-73bc-4e72-9b5d-1ba00114b772 service nova] Enqueued Resource ID: af1da677-d95a-4cec-95fa-b9208101b7dd with Priority: HIGHEST for action security_group_members [ 928.819687] env[65337]: INFO networking_nsxv3.common.synchronization [req-ffd4fe51-3ac7-4016-af2f-aaf9efc129ca req-e1122470-73bc-4e72-9b5d-1ba00114b772 service nova] Enqueued Resource ID: ea34178c-2bc2-4cb3-91f3-44fcc7f671bf with Priority: HIGHEST for action port [ 928.820241] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af1da677-d95a-4cec-95fa-b9208101b7dd with Priority: HIGHEST for action security_group_rules [ 928.820397] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af1da677-d95a-4cec-95fa-b9208101b7dd with Priority: HIGHEST for action security_group_members [ 928.820453] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea34178c-2bc2-4cb3-91f3-44fcc7f671bf with Priority: HIGHEST for action port [ 928.820837] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-af1da677-d95a-4cec-95fa-b9208101b7dd taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.820955] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.820955] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.821164] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.823755] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('af1da677-d95a-4cec-95fa-b9208101b7dd',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.823755] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-af1da677-d95a-4cec-95fa-b9208101b7dd taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.823755] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.823755] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-ea34178c-2bc2-4cb3-91f3-44fcc7f671bf taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.823755] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ea34178c-2bc2-4cb3-91f3-44fcc7f671bf" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.823755] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ea34178c-2bc2-4cb3-91f3-44fcc7f671bf" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.823755] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ea34178c-2bc2-4cb3-91f3-44fcc7f671bf" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.823755] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ea34178c-2bc2-4cb3-91f3-44fcc7f671bf',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.325835] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ea34178c-2bc2-4cb3-91f3-44fcc7f671bf with status ACTIVE [ 929.326192] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.326297] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.326353] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.326641] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.326641] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.326839] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.326937] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.327046] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.327177] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.327243] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.327425] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.327531] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.327613] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.327761] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.327836] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.328087] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ea34178c-2bc2-4cb3-91f3-44fcc7f671bf is going to be updated. [ 929.329409] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-af1da677-d95a-4cec-95fa-b9208101b7dd taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.329527] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.356516] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.356701] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.356701] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.356909] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.357057] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.357218] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ea34178c-2bc2-4cb3-91f3-44fcc7f671bf" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.947462] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94a13e53-dcf7-4643-ade4-8789dc9eabc4 in Status: SUCCESS [ 929.948253] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.948253] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.948253] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.948382] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.948437] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.948469] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.948683] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.948781] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.948961] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.948961] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('94a13e53-dcf7-4643-ade4-8789dc9eabc4',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.046165] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d in Status: SUCCESS [ 930.046367] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.046548] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.046768] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.046962] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.047088] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.047161] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.047328] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.047402] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.047488] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.047580] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('161889a4-32a2-48ee-8fb7-d2a961a4b28d',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.211619] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock network-395 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.211860] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "network-395" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.211995] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "network-395" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.212277] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "network-395" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.212538] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.212695] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.212808] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.213085] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.213288] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.213624] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 930.213624] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 930.213726] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 930.213819] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 930.213923] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 930.214147] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 930.214301] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 930.237253] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 930.237907] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 930.237907] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 930.237907] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "network-395" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.238427] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock port-c4403627-495f-4786-8561-4b2910ee5b56 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.238708] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "port-c4403627-495f-4786-8561-4b2910ee5b56" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.238862] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "port-c4403627-495f-4786-8561-4b2910ee5b56" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.239119] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "port-c4403627-495f-4786-8561-4b2910ee5b56" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.239260] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c4403627-495f-4786-8561-4b2910ee5b56',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.453136] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-94a13e53-dcf7-4643-ade4-8789dc9eabc4 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.453136] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.453136] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.453136] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.453136] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.453136] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.453136] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.453136] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.453136] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.453136] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.453136] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-94a13e53-dcf7-4643-ade4-8789dc9eabc4 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.453136] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.453136] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.453136] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.453136] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.453136] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.453874] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.453874] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.454913] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.454913] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.454913] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('94a13e53-dcf7-4643-ade4-8789dc9eabc4',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.456617] env[65337]: INFO networking_nsxv3.common.synchronization [None req-b5949d80-58d6-46c0-800e-dd6cab009a34 tempest-AttachInterfacesTestJSON-1783062477 tempest-AttachInterfacesTestJSON-1783062477-project-member] Enqueued Resource ID: 94a13e53-dcf7-4643-ade4-8789dc9eabc4 with Priority: HIGHEST for action security_group_members [ 930.457687] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94a13e53-dcf7-4643-ade4-8789dc9eabc4 with Priority: HIGHEST for action security_group_members [ 930.458141] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-94a13e53-dcf7-4643-ade4-8789dc9eabc4 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.458475] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.459376] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.459376] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.459376] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.459376] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.459376] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.459376] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.459376] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.460593] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('94a13e53-dcf7-4643-ade4-8789dc9eabc4',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.550444] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-161889a4-32a2-48ee-8fb7-d2a961a4b28d taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.550610] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.550699] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.550908] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.551114] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.551187] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.551237] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.551441] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.552389] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.552389] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.552389] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-161889a4-32a2-48ee-8fb7-d2a961a4b28d taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.552389] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.552389] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.552389] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.552389] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.552389] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.552389] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.552731] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.552731] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.552731] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.552731] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('161889a4-32a2-48ee-8fb7-d2a961a4b28d',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.742490] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.742740] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.742839] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.743242] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.743434] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.743708] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.743862] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.743982] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.744235] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.744368] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.744656] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.744799] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.744909] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.745454] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.745611] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.745754] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Resource: SegmentPort with ID: c4403627-495f-4786-8561-4b2910ee5b56 is going to be updated. [ 930.771725] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.771949] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.772090] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.772364] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.772555] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.772773] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "port-c4403627-495f-4786-8561-4b2910ee5b56" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.815507] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af1da677-d95a-4cec-95fa-b9208101b7dd in Status: SUCCESS [ 930.815804] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.816134] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.816441] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.816670] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.816818] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.816880] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.817217] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.817384] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.817532] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('af1da677-d95a-4cec-95fa-b9208101b7dd',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.957923] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 94a13e53-dcf7-4643-ade4-8789dc9eabc4: rpc.has_security_group_logging(os_id): False [ 930.961930] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('94a13e53-dcf7-4643-ade4-8789dc9eabc4',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.978073] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.978238] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.978357] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.978633] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.979395] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.979395] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.979395] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.979395] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.979395] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.979642] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.979677] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.979755] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.979812] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.979972] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.982737] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.982737] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.982737] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.982737] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.982737] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.982737] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.982737] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 94a13e53-dcf7-4643-ade4-8789dc9eabc4 is going to be updated. [ 931.055936] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 161889a4-32a2-48ee-8fb7-d2a961a4b28d: rpc.has_security_group_logging(os_id): False [ 931.058552] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.058705] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.058758] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.058978] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.059389] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.080587] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.080791] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.080892] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.081162] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.081279] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.081551] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.081669] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.081741] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.081921] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.082052] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.082302] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.082442] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.082514] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.082710] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.082760] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.082965] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.083258] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.083456] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.083675] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.083898] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.084074] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d is going to be created. [ 931.087801] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 94a13e53-dcf7-4643-ade4-8789dc9eabc4 in Status: IN_PROGRESS for 2s [ 931.203316] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.203878] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.204018] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.204215] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.204405] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.228880] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d in Status: IN_PROGRESS for 2s [ 931.321606] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('af1da677-d95a-4cec-95fa-b9208101b7dd',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.464972] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('94a13e53-dcf7-4643-ade4-8789dc9eabc4',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.515350] env[65337]: INFO networking_nsxv3.common.synchronization [req-c12b5b91-c2b6-4c1a-b7bd-28812e06c6e6 req-8cb6da8a-9df6-4c1b-b9be-a87ec29b52bc service nova] Enqueued Resource ID: b2e84376-5c9f-45e7-9949-59bf17a96c95 with Priority: HIGHEST for action security_group_rules [ 931.515543] env[65337]: INFO networking_nsxv3.common.synchronization [req-c12b5b91-c2b6-4c1a-b7bd-28812e06c6e6 req-8cb6da8a-9df6-4c1b-b9be-a87ec29b52bc service nova] Enqueued Resource ID: b2e84376-5c9f-45e7-9949-59bf17a96c95 with Priority: HIGHEST for action security_group_members [ 931.515865] env[65337]: INFO networking_nsxv3.common.synchronization [req-c12b5b91-c2b6-4c1a-b7bd-28812e06c6e6 req-8cb6da8a-9df6-4c1b-b9be-a87ec29b52bc service nova] Enqueued Resource ID: c4403627-495f-4786-8561-4b2910ee5b56 with Priority: HIGHEST for action port [ 931.516192] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2e84376-5c9f-45e7-9949-59bf17a96c95 with Priority: HIGHEST for action security_group_rules [ 931.516328] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2e84376-5c9f-45e7-9949-59bf17a96c95 with Priority: HIGHEST for action security_group_members [ 931.516422] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4403627-495f-4786-8561-4b2910ee5b56 with Priority: HIGHEST for action port [ 931.516795] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b2e84376-5c9f-45e7-9949-59bf17a96c95 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.516795] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b2e84376-5c9f-45e7-9949-59bf17a96c95" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.517057] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b2e84376-5c9f-45e7-9949-59bf17a96c95" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.517217] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b2e84376-5c9f-45e7-9949-59bf17a96c95" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.517335] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b2e84376-5c9f-45e7-9949-59bf17a96c95',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.518530] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-b2e84376-5c9f-45e7-9949-59bf17a96c95 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.518646] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b2e84376-5c9f-45e7-9949-59bf17a96c95" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.518712] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b2e84376-5c9f-45e7-9949-59bf17a96c95" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.518887] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b2e84376-5c9f-45e7-9949-59bf17a96c95" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.519078] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.519141] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.519184] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.519334] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.519422] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.519531] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b2e84376-5c9f-45e7-9949-59bf17a96c95',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.520458] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-c4403627-495f-4786-8561-4b2910ee5b56 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.520458] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c4403627-495f-4786-8561-4b2910ee5b56" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.520458] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c4403627-495f-4786-8561-4b2910ee5b56" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.520567] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c4403627-495f-4786-8561-4b2910ee5b56" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.520638] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c4403627-495f-4786-8561-4b2910ee5b56',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.825303] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('af1da677-d95a-4cec-95fa-b9208101b7dd',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.967940] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.968148] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.968148] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.968374] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.968434] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.968511] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 94a13e53-dcf7-4643-ade4-8789dc9eabc4 is going to be updated. [ 932.002521] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.002692] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.002744] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.002971] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.003143] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.012594] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94a13e53-dcf7-4643-ade4-8789dc9eabc4 in Status: IN_PROGRESS for 2s [ 932.023421] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-b2e84376-5c9f-45e7-9949-59bf17a96c95 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.023421] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b2e84376-5c9f-45e7-9949-59bf17a96c95" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.023638] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b2e84376-5c9f-45e7-9949-59bf17a96c95',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.024514] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c4403627-495f-4786-8561-4b2910ee5b56 with status ACTIVE [ 932.025527] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.025527] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.025527] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.025527] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.025527] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.025527] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.025912] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.025912] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.025912] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.025912] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.026640] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.027020] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.027020] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.027020] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.027361] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.027509] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c4403627-495f-4786-8561-4b2910ee5b56 is going to be updated. [ 932.060803] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.061022] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.061022] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.061255] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.061423] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.061579] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c4403627-495f-4786-8561-4b2910ee5b56" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.331381] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.331381] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.331381] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.331381] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.331381] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.331381] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: af1da677-d95a-4cec-95fa-b9208101b7dd is going to be updated. [ 932.368029] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.368029] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.368029] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.368029] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.368029] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.394450] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af1da677-d95a-4cec-95fa-b9208101b7dd in Status: IN_PROGRESS for 2s [ 932.531568] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b2e84376-5c9f-45e7-9949-59bf17a96c95',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.034513] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.034728] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.034829] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.035126] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.035237] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.035338] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b2e84376-5c9f-45e7-9949-59bf17a96c95 is going to be updated. [ 933.072048] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.072048] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.072048] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.072550] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.072687] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.085173] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b2e84376-5c9f-45e7-9949-59bf17a96c95 in Status: IN_PROGRESS for 2s [ 933.105236] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 94a13e53-dcf7-4643-ade4-8789dc9eabc4 in Status: SUCCESS [ 933.105481] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.248679] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d in Status: SUCCESS [ 933.249205] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.353175] env[65337]: INFO networking_nsxv3.common.synchronization [req-95522f41-fab0-4318-a33a-e784e178d9f8 req-fe16bf6c-f9fc-4829-91f8-a5d92539aeb4 tempest-ServerAddressesNegativeTestJSON-1173598156 tempest-ServerAddressesNegativeTestJSON-1173598156-project-member] Enqueued Resource ID: 8bec5c31-54b4-445a-a5e0-e51ba219c384 with Priority: HIGHEST for action security_group_members [ 933.353795] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8bec5c31-54b4-445a-a5e0-e51ba219c384 with Priority: HIGHEST for action security_group_members [ 933.354165] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bec5c31-54b4-445a-a5e0-e51ba219c384 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.354312] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bec5c31-54b4-445a-a5e0-e51ba219c384" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.354383] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bec5c31-54b4-445a-a5e0-e51ba219c384" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.354662] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bec5c31-54b4-445a-a5e0-e51ba219c384" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.354823] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.354988] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.354988] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.355331] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.355407] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.355502] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8bec5c31-54b4-445a-a5e0-e51ba219c384',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.858429] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.858896] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.858896] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.859075] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.859198] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.859462] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.859602] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.859687] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.859921] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.860057] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.860191] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8bec5c31-54b4-445a-a5e0-e51ba219c384 already deleted. [ 933.860319] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bec5c31-54b4-445a-a5e0-e51ba219c384" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.914900] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock network-990 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.915206] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "network-990" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.915316] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "network-990" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.916425] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "network-990" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.916425] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.916425] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.916425] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.917474] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.917474] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.917474] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 933.917474] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 933.917474] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 933.917737] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 933.917737] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 933.918238] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 933.918238] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 933.946780] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 933.947060] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 933.947264] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 933.947505] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "network-990" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.947939] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock port-ce101876-782b-4850-8ab7-f4e9b506ac7d taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.948167] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "port-ce101876-782b-4850-8ab7-f4e9b506ac7d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.948304] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "port-ce101876-782b-4850-8ab7-f4e9b506ac7d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.948680] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "port-ce101876-782b-4850-8ab7-f4e9b506ac7d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.949050] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ce101876-782b-4850-8ab7-f4e9b506ac7d',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.027364] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94a13e53-dcf7-4643-ade4-8789dc9eabc4 in Status: SUCCESS [ 934.027364] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.404844] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af1da677-d95a-4cec-95fa-b9208101b7dd in Status: SUCCESS [ 934.405297] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.405665] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.405931] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.406199] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.406323] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.406420] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.406592] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.406678] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.406765] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.406856] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('af1da677-d95a-4cec-95fa-b9208101b7dd',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.452083] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.452306] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.452461] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.452687] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.452832] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.452999] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Segment Port ce101876-782b-4850-8ab7-f4e9b506ac7d not found, creating... [ 934.453294] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.453451] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.453580] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.453808] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.453976] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.454317] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.454485] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.454600] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.454853] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.454995] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.455184] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Resource: SegmentPort with ID: ce101876-782b-4850-8ab7-f4e9b506ac7d is going to be created. [ 934.494089] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.494089] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.494355] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.494530] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.494909] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.495318] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "port-ce101876-782b-4850-8ab7-f4e9b506ac7d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.911078] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-af1da677-d95a-4cec-95fa-b9208101b7dd taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.911078] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.911078] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.911078] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.911078] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.911078] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.911078] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.911078] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.911078] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.911078] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.911078] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-af1da677-d95a-4cec-95fa-b9208101b7dd taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.911078] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.911078] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.912118] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.912118] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.912118] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.912118] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.912118] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.912118] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.912118] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.912118] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('af1da677-d95a-4cec-95fa-b9208101b7dd',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.926896] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock network-250 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.926896] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "network-250" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.927227] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "network-250" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.927343] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "network-250" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.927627] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.927821] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.927915] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.928135] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.928277] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.928493] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 934.928607] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 934.928726] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 934.928846] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 934.928958] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 934.929145] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 934.929304] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 934.953113] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 934.953362] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 934.953517] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 934.953764] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "network-250" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.954210] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock port-24af48e8-efc0-47ba-a15d-05191f7487a0 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.954460] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "port-24af48e8-efc0-47ba-a15d-05191f7487a0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.954645] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "port-24af48e8-efc0-47ba-a15d-05191f7487a0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.954935] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "port-24af48e8-efc0-47ba-a15d-05191f7487a0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.955173] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('24af48e8-efc0-47ba-a15d-05191f7487a0',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.096328] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b2e84376-5c9f-45e7-9949-59bf17a96c95 in Status: SUCCESS [ 935.096643] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b2e84376-5c9f-45e7-9949-59bf17a96c95" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.096813] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b2e84376-5c9f-45e7-9949-59bf17a96c95" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.097047] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b2e84376-5c9f-45e7-9949-59bf17a96c95" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.097515] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.097667] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.097765] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.097955] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.098058] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.098216] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b2e84376-5c9f-45e7-9949-59bf17a96c95" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.098313] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b2e84376-5c9f-45e7-9949-59bf17a96c95',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.196698] env[65337]: INFO networking_nsxv3.common.synchronization [req-95522f41-fab0-4318-a33a-e784e178d9f8 req-7ac462be-b87d-48be-af11-e2080ea46f84 service nova] Enqueued Resource ID: 8bec5c31-54b4-445a-a5e0-e51ba219c384 with Priority: HIGHEST for action security_group_rules [ 935.196883] env[65337]: INFO networking_nsxv3.common.synchronization [req-95522f41-fab0-4318-a33a-e784e178d9f8 req-7ac462be-b87d-48be-af11-e2080ea46f84 service nova] Enqueued Resource ID: 8bec5c31-54b4-445a-a5e0-e51ba219c384 with Priority: HIGHEST for action security_group_members [ 935.197324] env[65337]: INFO networking_nsxv3.common.synchronization [req-95522f41-fab0-4318-a33a-e784e178d9f8 req-7ac462be-b87d-48be-af11-e2080ea46f84 service nova] Enqueued Resource ID: ce101876-782b-4850-8ab7-f4e9b506ac7d with Priority: HIGHEST for action port [ 935.197539] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8bec5c31-54b4-445a-a5e0-e51ba219c384 with Priority: HIGHEST for action security_group_rules [ 935.197741] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8bec5c31-54b4-445a-a5e0-e51ba219c384 with Priority: HIGHEST for action security_group_members [ 935.197889] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce101876-782b-4850-8ab7-f4e9b506ac7d with Priority: HIGHEST for action port [ 935.198302] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8bec5c31-54b4-445a-a5e0-e51ba219c384 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.198433] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8bec5c31-54b4-445a-a5e0-e51ba219c384" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.198499] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8bec5c31-54b4-445a-a5e0-e51ba219c384" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.198746] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8bec5c31-54b4-445a-a5e0-e51ba219c384" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.198829] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8bec5c31-54b4-445a-a5e0-e51ba219c384',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.199863] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bec5c31-54b4-445a-a5e0-e51ba219c384 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.199863] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bec5c31-54b4-445a-a5e0-e51ba219c384" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.199979] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bec5c31-54b4-445a-a5e0-e51ba219c384" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.200063] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bec5c31-54b4-445a-a5e0-e51ba219c384" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.200189] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.200282] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.200358] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.200513] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.200646] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.200682] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8bec5c31-54b4-445a-a5e0-e51ba219c384',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.201974] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-ce101876-782b-4850-8ab7-f4e9b506ac7d taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.201974] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ce101876-782b-4850-8ab7-f4e9b506ac7d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.202091] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ce101876-782b-4850-8ab7-f4e9b506ac7d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.202183] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ce101876-782b-4850-8ab7-f4e9b506ac7d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.202255] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ce101876-782b-4850-8ab7-f4e9b506ac7d',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.413835] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for af1da677-d95a-4cec-95fa-b9208101b7dd: rpc.has_security_group_logging(os_id): False [ 935.442138] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.442269] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.442269] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.442489] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.442583] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.442800] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.442903] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.442958] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.443182] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.443255] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.443439] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.443533] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.443597] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.443796] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.443878] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.444102] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.444209] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.444263] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.444393] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.444514] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.444606] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: af1da677-d95a-4cec-95fa-b9208101b7dd is going to be updated. [ 935.458564] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.458802] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.458934] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.459243] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.459394] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.459569] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Segment Port 24af48e8-efc0-47ba-a15d-05191f7487a0 not found, creating... [ 935.459800] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.459988] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.460120] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.460348] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.460482] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.460903] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.461110] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.461241] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.461492] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.461630] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.461792] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Resource: SegmentPort with ID: 24af48e8-efc0-47ba-a15d-05191f7487a0 is going to be created. [ 935.491808] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.492194] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.492194] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.492379] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.492619] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.492854] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "port-24af48e8-efc0-47ba-a15d-05191f7487a0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.550511] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.550511] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.550511] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.550511] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.550937] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.565847] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: af1da677-d95a-4cec-95fa-b9208101b7dd in Status: IN_PROGRESS for 2s [ 935.601427] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-b2e84376-5c9f-45e7-9949-59bf17a96c95 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.601677] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b2e84376-5c9f-45e7-9949-59bf17a96c95" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.601677] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b2e84376-5c9f-45e7-9949-59bf17a96c95" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.602041] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b2e84376-5c9f-45e7-9949-59bf17a96c95" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.602574] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.602704] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.602774] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.602959] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.603078] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.603160] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b2e84376-5c9f-45e7-9949-59bf17a96c95" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.603367] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-b2e84376-5c9f-45e7-9949-59bf17a96c95 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.603513] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b2e84376-5c9f-45e7-9949-59bf17a96c95" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.603617] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b2e84376-5c9f-45e7-9949-59bf17a96c95" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.603890] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b2e84376-5c9f-45e7-9949-59bf17a96c95" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.604173] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.604378] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.604481] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.604743] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.604906] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.605090] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b2e84376-5c9f-45e7-9949-59bf17a96c95" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.605193] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b2e84376-5c9f-45e7-9949-59bf17a96c95',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.703752] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bec5c31-54b4-445a-a5e0-e51ba219c384 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.703930] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bec5c31-54b4-445a-a5e0-e51ba219c384" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.704173] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8bec5c31-54b4-445a-a5e0-e51ba219c384',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.705322] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ce101876-782b-4850-8ab7-f4e9b506ac7d with status ACTIVE [ 935.705472] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.705599] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.705658] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.705909] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.706044] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.706280] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.706414] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.706414] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.706538] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.706585] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.706778] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.706882] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.706939] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.707120] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.707216] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.707299] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ce101876-782b-4850-8ab7-f4e9b506ac7d is going to be updated. [ 935.735175] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.735430] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.735430] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.735666] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.735846] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.736037] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ce101876-782b-4850-8ab7-f4e9b506ac7d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.107597] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b2e84376-5c9f-45e7-9949-59bf17a96c95: rpc.has_security_group_logging(os_id): False [ 936.126832] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.126832] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.126832] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.127107] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.146766] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.147103] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.147260] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.147465] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.147702] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.147829] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.147989] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.148106] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.148178] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.148379] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.148475] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.148692] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.148796] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.148873] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.149061] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.149189] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.149304] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b2e84376-5c9f-45e7-9949-59bf17a96c95 is going to be updated. [ 936.198879] env[65337]: INFO networking_nsxv3.common.synchronization [req-13793ad5-7898-429a-953d-82cab75bd6cc req-74b994de-9ef6-4862-9874-aff4e11f332e tempest-ListServerFiltersTestJSON-497303335 tempest-ListServerFiltersTestJSON-497303335-project-member] Enqueued Resource ID: c5bec24d-89af-4b5e-920b-dcaae02501f0 with Priority: HIGHEST for action security_group_members [ 936.199370] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5bec24d-89af-4b5e-920b-dcaae02501f0 with Priority: HIGHEST for action security_group_members [ 936.199703] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5bec24d-89af-4b5e-920b-dcaae02501f0 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.199818] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5bec24d-89af-4b5e-920b-dcaae02501f0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.199884] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5bec24d-89af-4b5e-920b-dcaae02501f0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.200091] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5bec24d-89af-4b5e-920b-dcaae02501f0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.200253] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.200372] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.200433] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.200590] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.200669] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.200758] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c5bec24d-89af-4b5e-920b-dcaae02501f0',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.209684] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8bec5c31-54b4-445a-a5e0-e51ba219c384',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.216422] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.216550] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.216644] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.216872] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.217079] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.228370] env[65337]: INFO networking_nsxv3.common.synchronization [req-d6013c8a-44a5-4b2c-80ce-a5759eefe306 req-18c68485-3fad-4378-9f04-1b695cbe1ef6 service nova] Enqueued Resource ID: 94a13e53-dcf7-4643-ade4-8789dc9eabc4 with Priority: HIGHEST for action security_group_rules [ 936.228593] env[65337]: INFO networking_nsxv3.common.synchronization [req-d6013c8a-44a5-4b2c-80ce-a5759eefe306 req-18c68485-3fad-4378-9f04-1b695cbe1ef6 service nova] Enqueued Resource ID: 94a13e53-dcf7-4643-ade4-8789dc9eabc4 with Priority: HIGHEST for action security_group_members [ 936.229052] env[65337]: INFO networking_nsxv3.common.synchronization [req-d6013c8a-44a5-4b2c-80ce-a5759eefe306 req-18c68485-3fad-4378-9f04-1b695cbe1ef6 service nova] Enqueued Resource ID: 24af48e8-efc0-47ba-a15d-05191f7487a0 with Priority: HIGHEST for action port [ 936.229851] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94a13e53-dcf7-4643-ade4-8789dc9eabc4 with Priority: HIGHEST for action security_group_rules [ 936.229851] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94a13e53-dcf7-4643-ade4-8789dc9eabc4 with Priority: HIGHEST for action security_group_members [ 936.229851] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24af48e8-efc0-47ba-a15d-05191f7487a0 with Priority: HIGHEST for action port [ 936.231015] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-94a13e53-dcf7-4643-ade4-8789dc9eabc4 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.231183] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.231265] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.231517] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.231613] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('94a13e53-dcf7-4643-ade4-8789dc9eabc4',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.234447] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-94a13e53-dcf7-4643-ade4-8789dc9eabc4 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.234572] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.234634] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.234807] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.234960] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.235092] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.235161] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.235303] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.235425] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.235482] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('94a13e53-dcf7-4643-ade4-8789dc9eabc4',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.236273] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-24af48e8-efc0-47ba-a15d-05191f7487a0 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.236435] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-24af48e8-efc0-47ba-a15d-05191f7487a0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.236435] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-24af48e8-efc0-47ba-a15d-05191f7487a0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.237354] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-24af48e8-efc0-47ba-a15d-05191f7487a0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.237354] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('24af48e8-efc0-47ba-a15d-05191f7487a0',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.237954] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b2e84376-5c9f-45e7-9949-59bf17a96c95 in Status: IN_PROGRESS for 2s [ 936.702788] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c5bec24d-89af-4b5e-920b-dcaae02501f0',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.711740] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.711934] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.711975] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.714435] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.714435] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.714435] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8bec5c31-54b4-445a-a5e0-e51ba219c384 is going to be created. [ 936.739540] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-94a13e53-dcf7-4643-ade4-8789dc9eabc4 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.740127] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.740855] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('94a13e53-dcf7-4643-ade4-8789dc9eabc4',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.743393] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.745572] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.745572] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.745572] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.745572] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.745572] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 24af48e8-efc0-47ba-a15d-05191f7487a0 with status ACTIVE [ 936.745572] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.745572] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.745572] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.745572] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.745947] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.746101] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.747132] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.747132] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.747132] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.747132] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.747132] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.747132] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.747132] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.747132] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.747132] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.747524] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 24af48e8-efc0-47ba-a15d-05191f7487a0 is going to be updated. [ 936.759029] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8bec5c31-54b4-445a-a5e0-e51ba219c384 in Status: UNINITIALIZED for 2s [ 936.769276] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.769528] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.769528] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.769756] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.769825] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.769979] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-24af48e8-efc0-47ba-a15d-05191f7487a0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.026647] env[65337]: INFO networking_nsxv3.common.synchronization [req-0cea2c6c-be20-4ab1-9fac-f3b7d915eab4 req-36b01d66-3f80-4358-bc3b-e1951a93280a tempest-ServerActionsTestJSON-704073373 tempest-ServerActionsTestJSON-704073373-project-member] Enqueued Resource ID: 5f51b41c-ca91-45cf-92a6-17398a529bbb with Priority: HIGHEST for action security_group_members [ 937.027535] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f51b41c-ca91-45cf-92a6-17398a529bbb with Priority: HIGHEST for action security_group_members [ 937.027984] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f51b41c-ca91-45cf-92a6-17398a529bbb taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.028166] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f51b41c-ca91-45cf-92a6-17398a529bbb" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.028230] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f51b41c-ca91-45cf-92a6-17398a529bbb" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.028909] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f51b41c-ca91-45cf-92a6-17398a529bbb" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.028909] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.030114] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.030114] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.030114] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.030114] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.030114] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5f51b41c-ca91-45cf-92a6-17398a529bbb',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.205794] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c5bec24d-89af-4b5e-920b-dcaae02501f0',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.250441] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('94a13e53-dcf7-4643-ade4-8789dc9eabc4',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.430019] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock network-433 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.430019] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "network-433" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.430019] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "network-433" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.430019] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "network-433" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.430483] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.431074] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.431348] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.431923] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.432669] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.435535] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 937.435535] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 937.435535] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 937.435535] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 937.435535] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 937.435535] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 937.435535] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 937.459372] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 937.459372] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 937.459372] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 937.459372] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "network-433" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.460095] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock port-e5a843d7-d8f2-45e2-8de2-02d62114f8a9 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.460435] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "port-e5a843d7-d8f2-45e2-8de2-02d62114f8a9" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.460633] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "port-e5a843d7-d8f2-45e2-8de2-02d62114f8a9" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.461321] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "port-e5a843d7-d8f2-45e2-8de2-02d62114f8a9" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.461508] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e5a843d7-d8f2-45e2-8de2-02d62114f8a9',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.533479] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.533943] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.534066] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.534315] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.534460] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.534656] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.534747] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.534806] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.534949] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.535096] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.535197] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5f51b41c-ca91-45cf-92a6-17398a529bbb already deleted. [ 937.535298] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f51b41c-ca91-45cf-92a6-17398a529bbb" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.583809] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: af1da677-d95a-4cec-95fa-b9208101b7dd in Status: SUCCESS [ 937.584067] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.710501] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.713443] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.713588] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.713837] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.713945] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.714065] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5bec24d-89af-4b5e-920b-dcaae02501f0 is going to be updated. [ 937.746405] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.746639] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.746639] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.746854] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.746965] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.753710] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.753882] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.754022] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.754168] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.754258] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.754461] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 94a13e53-dcf7-4643-ade4-8789dc9eabc4 is going to be updated. [ 937.756846] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5bec24d-89af-4b5e-920b-dcaae02501f0 in Status: IN_PROGRESS for 2s [ 937.786797] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.786974] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.787037] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.787256] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.787397] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.799255] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94a13e53-dcf7-4643-ade4-8789dc9eabc4 in Status: IN_PROGRESS for 2s [ 937.964091] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.964330] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.964448] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.964999] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.965195] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.965454] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Segment Port e5a843d7-d8f2-45e2-8de2-02d62114f8a9 not found, creating... [ 937.965919] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.966220] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.966409] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.966683] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.966832] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.967169] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.967378] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.967508] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.967732] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.967866] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.968017] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Resource: SegmentPort with ID: e5a843d7-d8f2-45e2-8de2-02d62114f8a9 is going to be created. [ 937.990789] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.991091] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.991226] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.991511] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.991797] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.992095] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "port-e5a843d7-d8f2-45e2-8de2-02d62114f8a9" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.255892] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b2e84376-5c9f-45e7-9949-59bf17a96c95 in Status: SUCCESS [ 938.256214] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b2e84376-5c9f-45e7-9949-59bf17a96c95" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.668816] env[65337]: INFO networking_nsxv3.common.synchronization [req-0cea2c6c-be20-4ab1-9fac-f3b7d915eab4 req-842ff28d-ba38-4ab9-8866-60457379e5e9 service nova] Enqueued Resource ID: 5f51b41c-ca91-45cf-92a6-17398a529bbb with Priority: HIGHEST for action security_group_rules [ 938.669270] env[65337]: INFO networking_nsxv3.common.synchronization [req-0cea2c6c-be20-4ab1-9fac-f3b7d915eab4 req-842ff28d-ba38-4ab9-8866-60457379e5e9 service nova] Enqueued Resource ID: 5f51b41c-ca91-45cf-92a6-17398a529bbb with Priority: HIGHEST for action security_group_members [ 938.669376] env[65337]: INFO networking_nsxv3.common.synchronization [req-0cea2c6c-be20-4ab1-9fac-f3b7d915eab4 req-842ff28d-ba38-4ab9-8866-60457379e5e9 service nova] Enqueued Resource ID: e5a843d7-d8f2-45e2-8de2-02d62114f8a9 with Priority: HIGHEST for action port [ 938.669990] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f51b41c-ca91-45cf-92a6-17398a529bbb with Priority: HIGHEST for action security_group_rules [ 938.670171] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f51b41c-ca91-45cf-92a6-17398a529bbb with Priority: HIGHEST for action security_group_members [ 938.670307] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5a843d7-d8f2-45e2-8de2-02d62114f8a9 with Priority: HIGHEST for action port [ 938.670676] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5f51b41c-ca91-45cf-92a6-17398a529bbb taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.670836] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5f51b41c-ca91-45cf-92a6-17398a529bbb" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.670919] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5f51b41c-ca91-45cf-92a6-17398a529bbb" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.671321] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5f51b41c-ca91-45cf-92a6-17398a529bbb" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.671321] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5f51b41c-ca91-45cf-92a6-17398a529bbb',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.672340] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f51b41c-ca91-45cf-92a6-17398a529bbb taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.672484] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f51b41c-ca91-45cf-92a6-17398a529bbb" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.672567] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f51b41c-ca91-45cf-92a6-17398a529bbb" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.672779] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f51b41c-ca91-45cf-92a6-17398a529bbb" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.672969] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.674038] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.674122] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.674278] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.674364] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.674472] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5f51b41c-ca91-45cf-92a6-17398a529bbb',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.675287] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-e5a843d7-d8f2-45e2-8de2-02d62114f8a9 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.675404] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e5a843d7-d8f2-45e2-8de2-02d62114f8a9" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.675602] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e5a843d7-d8f2-45e2-8de2-02d62114f8a9" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.675666] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e5a843d7-d8f2-45e2-8de2-02d62114f8a9" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.675745] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e5a843d7-d8f2-45e2-8de2-02d62114f8a9',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.770687] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8bec5c31-54b4-445a-a5e0-e51ba219c384 in Status: SUCCESS [ 938.771058] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bec5c31-54b4-445a-a5e0-e51ba219c384" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.771256] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bec5c31-54b4-445a-a5e0-e51ba219c384" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.771473] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bec5c31-54b4-445a-a5e0-e51ba219c384" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.771663] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.771779] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.771846] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.772010] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.772095] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.772180] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bec5c31-54b4-445a-a5e0-e51ba219c384" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.772267] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8bec5c31-54b4-445a-a5e0-e51ba219c384',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.178615] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f51b41c-ca91-45cf-92a6-17398a529bbb taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.178809] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f51b41c-ca91-45cf-92a6-17398a529bbb" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.178979] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5f51b41c-ca91-45cf-92a6-17398a529bbb',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.179957] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e5a843d7-d8f2-45e2-8de2-02d62114f8a9 with status ACTIVE [ 939.180168] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.180290] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.180360] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.180867] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.180867] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.180867] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.181071] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.181071] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.181161] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.181252] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.181417] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.181513] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.181573] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.181707] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.182775] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.183208] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e5a843d7-d8f2-45e2-8de2-02d62114f8a9 is going to be updated. [ 939.211751] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.211949] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.211995] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.212206] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.212341] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.212567] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e5a843d7-d8f2-45e2-8de2-02d62114f8a9" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.274603] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bec5c31-54b4-445a-a5e0-e51ba219c384 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.274603] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bec5c31-54b4-445a-a5e0-e51ba219c384" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.274969] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bec5c31-54b4-445a-a5e0-e51ba219c384" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.274969] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bec5c31-54b4-445a-a5e0-e51ba219c384" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.275638] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.275638] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.275638] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.275804] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.275957] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.276177] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bec5c31-54b4-445a-a5e0-e51ba219c384" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.276408] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bec5c31-54b4-445a-a5e0-e51ba219c384 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.276577] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bec5c31-54b4-445a-a5e0-e51ba219c384" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.277038] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bec5c31-54b4-445a-a5e0-e51ba219c384" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.277038] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bec5c31-54b4-445a-a5e0-e51ba219c384" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.277308] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.277432] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.277511] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.277664] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.277746] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.277831] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bec5c31-54b4-445a-a5e0-e51ba219c384" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.278049] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8bec5c31-54b4-445a-a5e0-e51ba219c384',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.597819] env[65337]: INFO networking_nsxv3.common.synchronization [None req-524da575-7aed-4a8f-9ec6-1c0508400eda None None] Enqueued Resource ID: c00842a9-fd36-478c-9b48-49b6a1aaf91f with Priority: HIGHEST for action port [ 939.598487] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c00842a9-fd36-478c-9b48-49b6a1aaf91f with Priority: HIGHEST for action port [ 939.598908] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-c00842a9-fd36-478c-9b48-49b6a1aaf91f taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.602416] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c00842a9-fd36-478c-9b48-49b6a1aaf91f" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.602416] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c00842a9-fd36-478c-9b48-49b6a1aaf91f" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.602713] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c00842a9-fd36-478c-9b48-49b6a1aaf91f" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.602882] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c00842a9-fd36-478c-9b48-49b6a1aaf91f',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.686206] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5f51b41c-ca91-45cf-92a6-17398a529bbb',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.743716] env[65337]: INFO networking_nsxv3.common.synchronization [req-1aaaa5be-b720-4b9c-ac80-80475c59eab5 req-df515016-a81f-4838-96fb-9ddf85a81e14 tempest-ServerActionsV293TestJSON-1489208508 tempest-ServerActionsV293TestJSON-1489208508-project-member] Enqueued Resource ID: 287fa792-d512-4fba-b686-899daae58d0e with Priority: HIGHEST for action security_group_members [ 939.744166] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 287fa792-d512-4fba-b686-899daae58d0e with Priority: HIGHEST for action security_group_members [ 939.744482] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-287fa792-d512-4fba-b686-899daae58d0e taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.744622] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-287fa792-d512-4fba-b686-899daae58d0e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.744690] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-287fa792-d512-4fba-b686-899daae58d0e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.744972] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-287fa792-d512-4fba-b686-899daae58d0e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.745635] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.747844] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.747844] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.747844] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.747844] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.747844] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('287fa792-d512-4fba-b686-899daae58d0e',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.773338] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5bec24d-89af-4b5e-920b-dcaae02501f0 in Status: SUCCESS [ 939.773338] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5bec24d-89af-4b5e-920b-dcaae02501f0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.780349] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8bec5c31-54b4-445a-a5e0-e51ba219c384: rpc.has_security_group_logging(os_id): False [ 939.807120] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.807402] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.807402] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.807639] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.807704] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.807892] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.807988] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.808060] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.808210] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.808281] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.808469] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.808558] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.808615] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.808745] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.808816] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.808995] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.811131] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.811334] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.812253] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.812355] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.812468] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8bec5c31-54b4-445a-a5e0-e51ba219c384 is going to be created. [ 939.816767] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94a13e53-dcf7-4643-ade4-8789dc9eabc4 in Status: SUCCESS [ 939.816767] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.816894] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.817841] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.817841] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.817841] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.817841] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.817841] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.818087] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.818087] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.818087] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('94a13e53-dcf7-4643-ade4-8789dc9eabc4',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.887322] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.887535] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.889183] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.889183] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.889183] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.910121] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8bec5c31-54b4-445a-a5e0-e51ba219c384 in Status: IN_PROGRESS for 2s [ 940.106545] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c00842a9-fd36-478c-9b48-49b6a1aaf91f [ 940.106865] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.107094] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.107214] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.107538] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.107776] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.107841] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c00842a9-fd36-478c-9b48-49b6a1aaf91f already deleted. [ 940.108038] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c00842a9-fd36-478c-9b48-49b6a1aaf91f" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.189755] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.189916] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.189995] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.190235] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.190325] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.190429] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5f51b41c-ca91-45cf-92a6-17398a529bbb is going to be created. [ 940.205776] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock network-935 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.206234] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "network-935" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.206646] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "network-935" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.207370] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "network-935" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.207370] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.207512] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.207614] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.207791] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.208107] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.208422] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 940.208544] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 940.208658] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 940.208768] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 940.208878] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 940.208983] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 940.209189] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 940.221540] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.221701] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.221808] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.221969] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.222143] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.230499] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 940.230726] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 940.230876] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 940.231072] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "network-935" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.231664] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock port-567c90a8-709f-4dfb-82ac-db104ad3c626 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.231849] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "port-567c90a8-709f-4dfb-82ac-db104ad3c626" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.231849] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "port-567c90a8-709f-4dfb-82ac-db104ad3c626" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.232570] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "port-567c90a8-709f-4dfb-82ac-db104ad3c626" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.232570] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('567c90a8-709f-4dfb-82ac-db104ad3c626',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.238074] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f51b41c-ca91-45cf-92a6-17398a529bbb in Status: UNINITIALIZED for 2s [ 940.249440] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.250523] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.250523] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.250523] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.250523] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.250523] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.250523] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.250732] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.250732] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.250817] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.250884] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 287fa792-d512-4fba-b686-899daae58d0e already deleted. [ 940.250967] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-287fa792-d512-4fba-b686-899daae58d0e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.321087] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-94a13e53-dcf7-4643-ade4-8789dc9eabc4 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.321526] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.321526] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.324748] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.324748] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.324748] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.324748] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.324748] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.324748] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.324748] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.324748] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-94a13e53-dcf7-4643-ade4-8789dc9eabc4 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.324748] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.324748] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.324748] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.324748] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.324748] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.324748] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.324748] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.324748] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.324748] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.324748] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('94a13e53-dcf7-4643-ade4-8789dc9eabc4',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.735144] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.736036] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.736036] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.736036] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.736036] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.736247] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Segment Port 567c90a8-709f-4dfb-82ac-db104ad3c626 not found, creating... [ 940.736499] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.737240] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.737240] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.737240] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.737240] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.737740] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.737740] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.737885] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.738072] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.738211] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.738350] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Resource: SegmentPort with ID: 567c90a8-709f-4dfb-82ac-db104ad3c626 is going to be created. [ 940.766747] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.767015] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.767475] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.767557] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.767763] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.768009] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "port-567c90a8-709f-4dfb-82ac-db104ad3c626" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.827641] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 94a13e53-dcf7-4643-ade4-8789dc9eabc4: rpc.has_security_group_logging(os_id): False [ 940.852886] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.853194] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.853194] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.853501] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.853592] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.853812] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.854185] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.854185] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.854185] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.854367] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.854490] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.854589] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.854754] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.854970] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.855099] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.855439] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.855544] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.855607] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.855758] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.855826] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.855945] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 94a13e53-dcf7-4643-ade4-8789dc9eabc4 is going to be updated. [ 940.949785] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.949987] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.950071] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.950314] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.950519] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.099801] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 94a13e53-dcf7-4643-ade4-8789dc9eabc4 in Status: IN_PROGRESS for 2s [ 941.561259] env[65337]: INFO networking_nsxv3.common.synchronization [req-1aaaa5be-b720-4b9c-ac80-80475c59eab5 req-7a06fc97-7c7f-46cd-98fd-66c1cd3bfe38 service nova] Enqueued Resource ID: 287fa792-d512-4fba-b686-899daae58d0e with Priority: HIGHEST for action security_group_rules [ 941.563247] env[65337]: INFO networking_nsxv3.common.synchronization [req-1aaaa5be-b720-4b9c-ac80-80475c59eab5 req-7a06fc97-7c7f-46cd-98fd-66c1cd3bfe38 service nova] Enqueued Resource ID: 287fa792-d512-4fba-b686-899daae58d0e with Priority: HIGHEST for action security_group_members [ 941.563247] env[65337]: INFO networking_nsxv3.common.synchronization [req-1aaaa5be-b720-4b9c-ac80-80475c59eab5 req-7a06fc97-7c7f-46cd-98fd-66c1cd3bfe38 service nova] Enqueued Resource ID: 567c90a8-709f-4dfb-82ac-db104ad3c626 with Priority: HIGHEST for action port [ 941.564141] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 287fa792-d512-4fba-b686-899daae58d0e with Priority: HIGHEST for action security_group_rules [ 941.566250] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 287fa792-d512-4fba-b686-899daae58d0e with Priority: HIGHEST for action security_group_members [ 941.566250] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 567c90a8-709f-4dfb-82ac-db104ad3c626 with Priority: HIGHEST for action port [ 941.566250] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-287fa792-d512-4fba-b686-899daae58d0e taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.566250] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-287fa792-d512-4fba-b686-899daae58d0e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.566250] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-287fa792-d512-4fba-b686-899daae58d0e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.566250] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-287fa792-d512-4fba-b686-899daae58d0e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.566250] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('287fa792-d512-4fba-b686-899daae58d0e',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.568112] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-287fa792-d512-4fba-b686-899daae58d0e taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.568112] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-287fa792-d512-4fba-b686-899daae58d0e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.568112] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-287fa792-d512-4fba-b686-899daae58d0e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.568447] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-287fa792-d512-4fba-b686-899daae58d0e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.568447] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.568554] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.568606] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.568745] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.568845] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.569105] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('287fa792-d512-4fba-b686-899daae58d0e',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.570085] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-567c90a8-709f-4dfb-82ac-db104ad3c626 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.570209] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-567c90a8-709f-4dfb-82ac-db104ad3c626" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.570275] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-567c90a8-709f-4dfb-82ac-db104ad3c626" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.570640] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-567c90a8-709f-4dfb-82ac-db104ad3c626" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.570640] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('567c90a8-709f-4dfb-82ac-db104ad3c626',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.934658] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8bec5c31-54b4-445a-a5e0-e51ba219c384 in Status: SUCCESS [ 941.934955] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8bec5c31-54b4-445a-a5e0-e51ba219c384" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.069492] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-287fa792-d512-4fba-b686-899daae58d0e taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.069492] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-287fa792-d512-4fba-b686-899daae58d0e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.072721] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 567c90a8-709f-4dfb-82ac-db104ad3c626 with status ACTIVE [ 942.073225] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.073522] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.073617] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.073842] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.073929] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.074866] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.074961] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.075078] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.075265] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.075362] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.075542] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.075634] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.075692] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.075827] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.075899] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.075978] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 567c90a8-709f-4dfb-82ac-db104ad3c626 is going to be updated. [ 942.078695] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('287fa792-d512-4fba-b686-899daae58d0e',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.102155] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.102155] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.102155] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.102155] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.102155] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.102155] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-567c90a8-709f-4dfb-82ac-db104ad3c626" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.233531] env[65337]: INFO networking_nsxv3.common.synchronization [req-2ef671f9-584d-40d2-a059-2edd55b49bba req-efdc086a-60de-48a7-8cef-b711876dbed7 tempest-ServerActionsTestOtherA-84911055 tempest-ServerActionsTestOtherA-84911055-project-member] Enqueued Resource ID: e27d75d1-404e-406a-a69e-4560bd02b4cc with Priority: HIGHEST for action security_group_members [ 942.234488] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e27d75d1-404e-406a-a69e-4560bd02b4cc with Priority: HIGHEST for action security_group_members [ 942.234748] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-e27d75d1-404e-406a-a69e-4560bd02b4cc taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.234883] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e27d75d1-404e-406a-a69e-4560bd02b4cc" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.234948] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e27d75d1-404e-406a-a69e-4560bd02b4cc" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.235286] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e27d75d1-404e-406a-a69e-4560bd02b4cc" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.235988] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.235988] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.235988] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.235988] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.235988] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.236280] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e27d75d1-404e-406a-a69e-4560bd02b4cc',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.249210] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f51b41c-ca91-45cf-92a6-17398a529bbb in Status: SUCCESS [ 942.249450] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f51b41c-ca91-45cf-92a6-17398a529bbb" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.249661] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f51b41c-ca91-45cf-92a6-17398a529bbb" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.249907] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f51b41c-ca91-45cf-92a6-17398a529bbb" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.250160] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.250305] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.250398] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.250595] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.250659] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.250753] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f51b41c-ca91-45cf-92a6-17398a529bbb" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.250880] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5f51b41c-ca91-45cf-92a6-17398a529bbb',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.358780] env[65337]: INFO networking_nsxv3.common.synchronization [None req-8b2580b6-9ff7-455a-9ed8-b1ff2862ad8b None None] Enqueued Resource ID: aae52f46-791c-450e-83ec-fe7547530cc8 with Priority: HIGHEST for action port [ 942.359384] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aae52f46-791c-450e-83ec-fe7547530cc8 with Priority: HIGHEST for action port [ 942.359847] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-aae52f46-791c-450e-83ec-fe7547530cc8 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.359847] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aae52f46-791c-450e-83ec-fe7547530cc8" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.359847] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aae52f46-791c-450e-83ec-fe7547530cc8" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.360083] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aae52f46-791c-450e-83ec-fe7547530cc8" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.360168] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aae52f46-791c-450e-83ec-fe7547530cc8',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.582109] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('287fa792-d512-4fba-b686-899daae58d0e',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.702814] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock network-393 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.702932] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "network-393" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.703112] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "network-393" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.703401] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "network-393" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.706901] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.706901] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.706901] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.706901] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.706901] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.706901] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 942.706901] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 942.706901] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 942.706901] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 942.706901] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 942.706901] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 942.708140] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 942.730269] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 942.733762] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 942.733762] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 942.733762] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "network-393" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.733762] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock port-55f7c38a-124f-40ce-9fbe-44a13a5a8d1a taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.733762] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "port-55f7c38a-124f-40ce-9fbe-44a13a5a8d1a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.733762] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "port-55f7c38a-124f-40ce-9fbe-44a13a5a8d1a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.733762] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "port-55f7c38a-124f-40ce-9fbe-44a13a5a8d1a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.733762] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('55f7c38a-124f-40ce-9fbe-44a13a5a8d1a',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.740034] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.740034] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.740034] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.740034] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.740034] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.740034] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.740034] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.740034] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.740034] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.740034] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.740034] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e27d75d1-404e-406a-a69e-4560bd02b4cc already deleted. [ 942.740034] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e27d75d1-404e-406a-a69e-4560bd02b4cc" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.757032] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5f51b41c-ca91-45cf-92a6-17398a529bbb',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.863934] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port aae52f46-791c-450e-83ec-fe7547530cc8 [ 942.864755] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.864755] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.864913] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.865123] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.865214] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.865330] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:aae52f46-791c-450e-83ec-fe7547530cc8 already deleted. [ 942.865413] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aae52f46-791c-450e-83ec-fe7547530cc8" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.087613] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.087799] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.087849] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.088112] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.088231] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.088302] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 287fa792-d512-4fba-b686-899daae58d0e is going to be created. [ 943.118147] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 94a13e53-dcf7-4643-ade4-8789dc9eabc4 in Status: SUCCESS [ 943.118395] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.127643] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.127643] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.127643] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.127643] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.127643] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.146860] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 287fa792-d512-4fba-b686-899daae58d0e in Status: UNINITIALIZED for 2s [ 943.239494] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.240292] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.240292] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.240483] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.240712] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.240877] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Segment Port 55f7c38a-124f-40ce-9fbe-44a13a5a8d1a not found, creating... [ 943.241216] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.241387] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.241806] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.241806] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.242089] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.242410] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.242577] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.242694] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.242912] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.243132] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.243337] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Resource: SegmentPort with ID: 55f7c38a-124f-40ce-9fbe-44a13a5a8d1a is going to be created. [ 943.260623] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5f51b41c-ca91-45cf-92a6-17398a529bbb: rpc.has_security_group_logging(os_id): False [ 943.281930] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.282242] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.282395] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.282983] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.283283] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.283532] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "port-55f7c38a-124f-40ce-9fbe-44a13a5a8d1a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.290181] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.290382] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.290452] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.290614] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.290702] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.291045] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.291156] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.291222] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.291425] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.291483] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.291532] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5f51b41c-ca91-45cf-92a6-17398a529bbb is going to be created. [ 943.408762] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.408960] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.409068] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.409404] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.409732] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.423443] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5f51b41c-ca91-45cf-92a6-17398a529bbb in Status: IN_PROGRESS for 2s [ 944.117078] env[65337]: INFO networking_nsxv3.common.synchronization [req-2ef671f9-584d-40d2-a059-2edd55b49bba req-75b63dfc-b50d-4028-8961-6619120ca1fa service nova] Enqueued Resource ID: e27d75d1-404e-406a-a69e-4560bd02b4cc with Priority: HIGHEST for action security_group_rules [ 944.117078] env[65337]: INFO networking_nsxv3.common.synchronization [req-2ef671f9-584d-40d2-a059-2edd55b49bba req-75b63dfc-b50d-4028-8961-6619120ca1fa service nova] Enqueued Resource ID: e27d75d1-404e-406a-a69e-4560bd02b4cc with Priority: HIGHEST for action security_group_members [ 944.117078] env[65337]: INFO networking_nsxv3.common.synchronization [req-2ef671f9-584d-40d2-a059-2edd55b49bba req-75b63dfc-b50d-4028-8961-6619120ca1fa service nova] Enqueued Resource ID: 55f7c38a-124f-40ce-9fbe-44a13a5a8d1a with Priority: HIGHEST for action port [ 944.117078] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e27d75d1-404e-406a-a69e-4560bd02b4cc with Priority: HIGHEST for action security_group_rules [ 944.117078] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e27d75d1-404e-406a-a69e-4560bd02b4cc with Priority: HIGHEST for action security_group_members [ 944.117078] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55f7c38a-124f-40ce-9fbe-44a13a5a8d1a with Priority: HIGHEST for action port [ 944.117078] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e27d75d1-404e-406a-a69e-4560bd02b4cc taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.117078] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e27d75d1-404e-406a-a69e-4560bd02b4cc" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.118179] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e27d75d1-404e-406a-a69e-4560bd02b4cc" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.118514] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e27d75d1-404e-406a-a69e-4560bd02b4cc" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.118740] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e27d75d1-404e-406a-a69e-4560bd02b4cc',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.122210] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-e27d75d1-404e-406a-a69e-4560bd02b4cc taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.122210] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e27d75d1-404e-406a-a69e-4560bd02b4cc" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.122210] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e27d75d1-404e-406a-a69e-4560bd02b4cc" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.122210] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e27d75d1-404e-406a-a69e-4560bd02b4cc" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.122210] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.122210] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.122210] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.122210] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.122210] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.122210] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e27d75d1-404e-406a-a69e-4560bd02b4cc',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.123587] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-55f7c38a-124f-40ce-9fbe-44a13a5a8d1a taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.127557] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-55f7c38a-124f-40ce-9fbe-44a13a5a8d1a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.127557] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-55f7c38a-124f-40ce-9fbe-44a13a5a8d1a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.127557] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-55f7c38a-124f-40ce-9fbe-44a13a5a8d1a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.127557] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('55f7c38a-124f-40ce-9fbe-44a13a5a8d1a',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.476256] env[65337]: INFO networking_nsxv3.common.synchronization [req-96643829-83f7-450e-b518-6f538a99bdc9 req-a8d651bb-f696-44a4-bd0b-c887ea8f7967 tempest-ImagesOneServerNegativeTestJSON-1864647261 tempest-ImagesOneServerNegativeTestJSON-1864647261-project-member] Enqueued Resource ID: 12a747a0-2898-4059-bada-c453c5c41052 with Priority: HIGHEST for action security_group_members [ 944.476722] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12a747a0-2898-4059-bada-c453c5c41052 with Priority: HIGHEST for action security_group_members [ 944.477128] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-12a747a0-2898-4059-bada-c453c5c41052 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.477250] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12a747a0-2898-4059-bada-c453c5c41052" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.477313] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12a747a0-2898-4059-bada-c453c5c41052" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.477510] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12a747a0-2898-4059-bada-c453c5c41052" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.477664] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.477759] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.477818] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.477954] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.478055] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.478149] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('12a747a0-2898-4059-bada-c453c5c41052',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.627576] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e27d75d1-404e-406a-a69e-4560bd02b4cc',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.629231] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-e27d75d1-404e-406a-a69e-4560bd02b4cc taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.629231] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e27d75d1-404e-406a-a69e-4560bd02b4cc" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.629479] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 55f7c38a-124f-40ce-9fbe-44a13a5a8d1a with status ACTIVE [ 944.629685] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.629772] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.630265] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.630265] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.630265] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.630420] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.630471] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.630581] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.630715] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.630791] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.631033] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.631150] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.631222] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.631552] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.631552] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.631645] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 55f7c38a-124f-40ce-9fbe-44a13a5a8d1a is going to be updated. [ 944.660214] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.660324] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.660324] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.660607] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.660771] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.660965] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-55f7c38a-124f-40ce-9fbe-44a13a5a8d1a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.970175] env[65337]: INFO networking_nsxv3.common.synchronization [req-eab4b667-f3d0-4446-abbd-e70446f81f1b req-483af276-4a82-45d2-8dce-589a8ee2c9d5 tempest-ServerTagsTestJSON-199911095 tempest-ServerTagsTestJSON-199911095-project-member] Enqueued Resource ID: f1ba8c13-9b99-414f-9c5a-c8efc1ebc191 with Priority: HIGHEST for action security_group_members [ 944.970885] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1ba8c13-9b99-414f-9c5a-c8efc1ebc191 with Priority: HIGHEST for action security_group_members [ 944.971295] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-f1ba8c13-9b99-414f-9c5a-c8efc1ebc191 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.971426] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f1ba8c13-9b99-414f-9c5a-c8efc1ebc191" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.971488] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f1ba8c13-9b99-414f-9c5a-c8efc1ebc191" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.971769] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f1ba8c13-9b99-414f-9c5a-c8efc1ebc191" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.979377] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.979377] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.979377] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.979377] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.979377] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.979377] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f1ba8c13-9b99-414f-9c5a-c8efc1ebc191',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.982375] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.982375] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.982375] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.982375] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.982375] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.982375] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.982375] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.982375] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.982375] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.982375] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.982375] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12a747a0-2898-4059-bada-c453c5c41052 is going to be updated. [ 945.019839] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.020344] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.020727] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.021195] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.021448] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.033186] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12a747a0-2898-4059-bada-c453c5c41052 in Status: IN_PROGRESS for 2s [ 945.134297] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e27d75d1-404e-406a-a69e-4560bd02b4cc',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.165576] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 287fa792-d512-4fba-b686-899daae58d0e in Status: SUCCESS [ 945.165576] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-287fa792-d512-4fba-b686-899daae58d0e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.165576] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-287fa792-d512-4fba-b686-899daae58d0e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.165576] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-287fa792-d512-4fba-b686-899daae58d0e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.165576] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.165576] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.165576] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.165576] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.166475] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.166959] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-287fa792-d512-4fba-b686-899daae58d0e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.167205] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('287fa792-d512-4fba-b686-899daae58d0e',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.436938] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5f51b41c-ca91-45cf-92a6-17398a529bbb in Status: SUCCESS [ 945.437258] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5f51b41c-ca91-45cf-92a6-17398a529bbb" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.481213] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.481213] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.481213] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.481461] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.481582] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.481820] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.482018] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.482109] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.482307] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.482416] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.482753] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f1ba8c13-9b99-414f-9c5a-c8efc1ebc191 already deleted. [ 945.482857] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f1ba8c13-9b99-414f-9c5a-c8efc1ebc191" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.487293] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock network-134 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.487594] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "network-134" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.487727] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "network-134" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.488067] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "network-134" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.488338] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.488496] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.488752] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.488830] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.488962] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.489306] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 945.489456] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 945.489590] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 945.489722] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 945.489860] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 945.489989] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 945.490172] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 945.510743] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 945.510950] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 945.511265] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 945.511486] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "network-134" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.511989] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock port-e90dc2ba-36ea-4c37-83d6-5d57c484e918 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.512185] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "port-e90dc2ba-36ea-4c37-83d6-5d57c484e918" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.512381] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "port-e90dc2ba-36ea-4c37-83d6-5d57c484e918" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.512675] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "port-e90dc2ba-36ea-4c37-83d6-5d57c484e918" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.512814] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e90dc2ba-36ea-4c37-83d6-5d57c484e918',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.638449] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.638700] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.638700] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.638949] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.639061] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.639170] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e27d75d1-404e-406a-a69e-4560bd02b4cc is going to be created. [ 945.668554] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.670260] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.670260] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.670260] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.670260] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.670825] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('287fa792-d512-4fba-b686-899daae58d0e',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.684548] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e27d75d1-404e-406a-a69e-4560bd02b4cc in Status: UNINITIALIZED for 2s [ 946.015151] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.015394] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.015519] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.015934] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.016142] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.016318] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Segment Port e90dc2ba-36ea-4c37-83d6-5d57c484e918 not found, creating... [ 946.016605] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.016770] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.016878] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.017121] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.017255] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.017569] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.017725] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.017846] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.018139] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.018286] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.018423] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Resource: SegmentPort with ID: e90dc2ba-36ea-4c37-83d6-5d57c484e918 is going to be created. [ 946.044670] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.044885] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.045023] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.045577] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.045825] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.046301] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "port-e90dc2ba-36ea-4c37-83d6-5d57c484e918" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.173632] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 287fa792-d512-4fba-b686-899daae58d0e: rpc.has_security_group_logging(os_id): False [ 946.207567] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.207751] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.207809] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.208017] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.208110] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.208371] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.208474] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.208548] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.208691] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.208766] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.208850] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 287fa792-d512-4fba-b686-899daae58d0e is going to be created. [ 946.288415] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.288415] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.288415] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.288415] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.288415] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.317666] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 287fa792-d512-4fba-b686-899daae58d0e in Status: IN_PROGRESS for 2s [ 946.777911] env[65337]: INFO networking_nsxv3.common.synchronization [req-eab4b667-f3d0-4446-abbd-e70446f81f1b req-a5277397-0cba-47ce-a50c-d4a594225c83 service nova] Enqueued Resource ID: f1ba8c13-9b99-414f-9c5a-c8efc1ebc191 with Priority: HIGHEST for action security_group_rules [ 946.778107] env[65337]: INFO networking_nsxv3.common.synchronization [req-eab4b667-f3d0-4446-abbd-e70446f81f1b req-a5277397-0cba-47ce-a50c-d4a594225c83 service nova] Enqueued Resource ID: f1ba8c13-9b99-414f-9c5a-c8efc1ebc191 with Priority: HIGHEST for action security_group_members [ 946.778219] env[65337]: INFO networking_nsxv3.common.synchronization [req-eab4b667-f3d0-4446-abbd-e70446f81f1b req-a5277397-0cba-47ce-a50c-d4a594225c83 service nova] Enqueued Resource ID: e90dc2ba-36ea-4c37-83d6-5d57c484e918 with Priority: HIGHEST for action port [ 946.778795] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1ba8c13-9b99-414f-9c5a-c8efc1ebc191 with Priority: HIGHEST for action security_group_rules [ 946.778931] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1ba8c13-9b99-414f-9c5a-c8efc1ebc191 with Priority: HIGHEST for action security_group_members [ 946.779043] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e90dc2ba-36ea-4c37-83d6-5d57c484e918 with Priority: HIGHEST for action port [ 946.779339] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f1ba8c13-9b99-414f-9c5a-c8efc1ebc191 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.779680] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f1ba8c13-9b99-414f-9c5a-c8efc1ebc191" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.779680] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f1ba8c13-9b99-414f-9c5a-c8efc1ebc191" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.780506] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f1ba8c13-9b99-414f-9c5a-c8efc1ebc191" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.780506] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f1ba8c13-9b99-414f-9c5a-c8efc1ebc191',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.780810] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-f1ba8c13-9b99-414f-9c5a-c8efc1ebc191 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.780983] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f1ba8c13-9b99-414f-9c5a-c8efc1ebc191" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.781167] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f1ba8c13-9b99-414f-9c5a-c8efc1ebc191" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.781504] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f1ba8c13-9b99-414f-9c5a-c8efc1ebc191" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.781504] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.781504] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.781504] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.782608] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.782608] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.782608] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f1ba8c13-9b99-414f-9c5a-c8efc1ebc191',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.788108] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-e90dc2ba-36ea-4c37-83d6-5d57c484e918 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.788108] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e90dc2ba-36ea-4c37-83d6-5d57c484e918" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.788108] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e90dc2ba-36ea-4c37-83d6-5d57c484e918" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.788108] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e90dc2ba-36ea-4c37-83d6-5d57c484e918" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.788108] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e90dc2ba-36ea-4c37-83d6-5d57c484e918',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.047054] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12a747a0-2898-4059-bada-c453c5c41052 in Status: SUCCESS [ 947.047054] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12a747a0-2898-4059-bada-c453c5c41052 deletion is rescheduled due to dependency. [ 947.047054] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12a747a0-2898-4059-bada-c453c5c41052" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.218999] env[65337]: INFO networking_nsxv3.common.synchronization [req-25073b78-53da-45ef-8415-e56a3ba16ae0 req-183cf12c-fd36-498f-aba4-1180563c11e7 tempest-ServersTestJSON-1910122825 tempest-ServersTestJSON-1910122825-project-member] Enqueued Resource ID: af1da677-d95a-4cec-95fa-b9208101b7dd with Priority: HIGHEST for action security_group_members [ 947.219593] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af1da677-d95a-4cec-95fa-b9208101b7dd with Priority: HIGHEST for action security_group_members [ 947.219913] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-af1da677-d95a-4cec-95fa-b9208101b7dd taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.220201] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.221232] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.221232] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.221232] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.221232] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.221232] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.221232] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.221232] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.221232] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('af1da677-d95a-4cec-95fa-b9208101b7dd',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.289894] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-f1ba8c13-9b99-414f-9c5a-c8efc1ebc191 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.290152] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f1ba8c13-9b99-414f-9c5a-c8efc1ebc191" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.290531] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f1ba8c13-9b99-414f-9c5a-c8efc1ebc191',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.293084] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e90dc2ba-36ea-4c37-83d6-5d57c484e918 with status ACTIVE [ 947.293084] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.293084] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.293084] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.293084] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.293084] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.293084] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.293084] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.293084] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.293084] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.293580] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.293580] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.293580] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.293580] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.293580] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.293756] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.293756] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e90dc2ba-36ea-4c37-83d6-5d57c484e918 is going to be updated. [ 947.321746] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.321946] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.321946] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.322235] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.322421] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.322631] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e90dc2ba-36ea-4c37-83d6-5d57c484e918" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.694890] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e27d75d1-404e-406a-a69e-4560bd02b4cc in Status: SUCCESS [ 947.695156] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e27d75d1-404e-406a-a69e-4560bd02b4cc" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.695337] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e27d75d1-404e-406a-a69e-4560bd02b4cc" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.695665] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e27d75d1-404e-406a-a69e-4560bd02b4cc" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.695870] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.695990] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.696069] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.696239] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.696315] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.696403] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e27d75d1-404e-406a-a69e-4560bd02b4cc" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.696493] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e27d75d1-404e-406a-a69e-4560bd02b4cc',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.726495] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('af1da677-d95a-4cec-95fa-b9208101b7dd',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.792505] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f1ba8c13-9b99-414f-9c5a-c8efc1ebc191',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.199592] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e27d75d1-404e-406a-a69e-4560bd02b4cc',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.232323] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('af1da677-d95a-4cec-95fa-b9208101b7dd',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.296563] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.296797] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.296888] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.297153] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.297245] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.297342] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f1ba8c13-9b99-414f-9c5a-c8efc1ebc191 is going to be created. [ 948.332499] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.332499] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.332499] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.332752] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.332900] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.336723] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 287fa792-d512-4fba-b686-899daae58d0e in Status: SUCCESS [ 948.336948] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-287fa792-d512-4fba-b686-899daae58d0e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.347540] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f1ba8c13-9b99-414f-9c5a-c8efc1ebc191 in Status: UNINITIALIZED for 2s [ 948.491697] env[65337]: INFO networking_nsxv3.common.synchronization [req-cecdcfcd-f692-447c-a11a-aa6f035e34fe req-a6b1bad8-9ac8-4e6b-8712-ebb65fb53601 tempest-ImagesTestJSON-1531636912 tempest-ImagesTestJSON-1531636912-project-member] Enqueued Resource ID: 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 with Priority: HIGHEST for action security_group_members [ 948.492288] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 with Priority: HIGHEST for action security_group_members [ 948.492748] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.492914] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.492992] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.493783] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.493783] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.493911] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.494018] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.494815] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.495357] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.495357] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7db87dc2-69af-45f1-90c2-f8a4ec96c3b7',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.700744] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e27d75d1-404e-406a-a69e-4560bd02b4cc: rpc.has_security_group_logging(os_id): False [ 948.722030] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.722030] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.722030] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.722030] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.722030] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.722030] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.722030] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.722030] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.722030] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.722030] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.722030] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e27d75d1-404e-406a-a69e-4560bd02b4cc is going to be created. [ 948.734935] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.737330] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.737330] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.737330] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.737330] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.737330] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: af1da677-d95a-4cec-95fa-b9208101b7dd is going to be updated. [ 948.768920] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.769014] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.769078] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.769261] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.769416] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.779496] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af1da677-d95a-4cec-95fa-b9208101b7dd in Status: IN_PROGRESS for 2s [ 948.798990] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.799176] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.799272] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.800203] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.801642] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.814178] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e27d75d1-404e-406a-a69e-4560bd02b4cc in Status: IN_PROGRESS for 2s [ 948.935984] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock network-626 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.939346] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "network-626" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.939542] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "network-626" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.939895] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "network-626" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.940237] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.940581] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.940581] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.940788] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.940941] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.941200] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 948.941358] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 948.941494] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 948.941655] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 948.941978] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 948.941978] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 948.942249] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 948.967102] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 948.967281] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 948.967478] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 948.967624] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "network-626" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.967943] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock port-613d19f4-eede-4ded-b67f-a6b5dae4cec4 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.968135] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "port-613d19f4-eede-4ded-b67f-a6b5dae4cec4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.968291] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "port-613d19f4-eede-4ded-b67f-a6b5dae4cec4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.968710] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "port-613d19f4-eede-4ded-b67f-a6b5dae4cec4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.968710] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('613d19f4-eede-4ded-b67f-a6b5dae4cec4',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.998939] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.998939] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.999171] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.999264] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.999326] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.999566] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.999802] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.999802] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.999929] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.000068] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.000213] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 is going to be updated. [ 949.033819] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.034022] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.034140] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.034307] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.034451] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.045316] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 in Status: IN_PROGRESS for 2s [ 949.474030] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.474030] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.474030] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.474030] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.474030] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.474030] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Segment Port 613d19f4-eede-4ded-b67f-a6b5dae4cec4 not found, creating... [ 949.475767] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.475767] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.475767] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.475767] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.475767] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.476185] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.476425] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.476625] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.476903] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.477098] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.477412] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Resource: SegmentPort with ID: 613d19f4-eede-4ded-b67f-a6b5dae4cec4 is going to be created. [ 949.498653] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.498937] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.499137] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.499529] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.499805] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.500289] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "port-613d19f4-eede-4ded-b67f-a6b5dae4cec4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.272140] env[65337]: INFO networking_nsxv3.common.synchronization [req-cecdcfcd-f692-447c-a11a-aa6f035e34fe req-8b198cf9-e819-4b44-b73d-bece067ef049 service nova] Enqueued Resource ID: 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 with Priority: HIGHEST for action security_group_rules [ 950.272327] env[65337]: INFO networking_nsxv3.common.synchronization [req-cecdcfcd-f692-447c-a11a-aa6f035e34fe req-8b198cf9-e819-4b44-b73d-bece067ef049 service nova] Enqueued Resource ID: 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 with Priority: HIGHEST for action security_group_members [ 950.272627] env[65337]: INFO networking_nsxv3.common.synchronization [req-cecdcfcd-f692-447c-a11a-aa6f035e34fe req-8b198cf9-e819-4b44-b73d-bece067ef049 service nova] Enqueued Resource ID: 613d19f4-eede-4ded-b67f-a6b5dae4cec4 with Priority: HIGHEST for action port [ 950.273116] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 with Priority: HIGHEST for action security_group_rules [ 950.273294] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 with Priority: HIGHEST for action security_group_members [ 950.273396] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 613d19f4-eede-4ded-b67f-a6b5dae4cec4 with Priority: HIGHEST for action port [ 950.273687] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.273842] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.273921] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.274629] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.274761] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7db87dc2-69af-45f1-90c2-f8a4ec96c3b7',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.276261] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.277269] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.277641] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-613d19f4-eede-4ded-b67f-a6b5dae4cec4 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.277802] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-613d19f4-eede-4ded-b67f-a6b5dae4cec4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.277878] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-613d19f4-eede-4ded-b67f-a6b5dae4cec4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.278103] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-613d19f4-eede-4ded-b67f-a6b5dae4cec4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.278230] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('613d19f4-eede-4ded-b67f-a6b5dae4cec4',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.361251] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f1ba8c13-9b99-414f-9c5a-c8efc1ebc191 in Status: SUCCESS [ 950.361251] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f1ba8c13-9b99-414f-9c5a-c8efc1ebc191" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.361251] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f1ba8c13-9b99-414f-9c5a-c8efc1ebc191" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.361251] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f1ba8c13-9b99-414f-9c5a-c8efc1ebc191" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.361251] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.361251] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.361251] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.361607] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.361607] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.361607] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f1ba8c13-9b99-414f-9c5a-c8efc1ebc191" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.361717] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f1ba8c13-9b99-414f-9c5a-c8efc1ebc191',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.433434] env[65337]: INFO networking_nsxv3.common.synchronization [req-60ab2f3b-9e79-41c3-8502-fd90e65440ef req-91548954-01eb-4ea3-b8f6-fc73da229eb3 tempest-ServersAdminTestJSON-283641549 tempest-ServersAdminTestJSON-283641549-project-member] Enqueued Resource ID: 9e889ce7-965a-4de0-b096-60d4e743cf8b with Priority: HIGHEST for action security_group_members [ 950.434031] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e889ce7-965a-4de0-b096-60d4e743cf8b with Priority: HIGHEST for action security_group_members [ 950.434349] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e889ce7-965a-4de0-b096-60d4e743cf8b taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.434706] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.434706] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.434787] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.436039] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.436039] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.436039] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.436039] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.436039] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.436039] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e889ce7-965a-4de0-b096-60d4e743cf8b',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.780874] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.782302] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.782302] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 613d19f4-eede-4ded-b67f-a6b5dae4cec4 with status ACTIVE [ 950.782302] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.782302] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.782302] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.782655] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.782833] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.783181] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.786051] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.786051] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.786051] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.786051] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.786051] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.786051] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.786051] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.786051] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.786051] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.786051] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 613d19f4-eede-4ded-b67f-a6b5dae4cec4 is going to be updated. [ 950.794811] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af1da677-d95a-4cec-95fa-b9208101b7dd in Status: SUCCESS [ 950.794811] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.811472] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.811472] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.811472] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.811472] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.811472] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.811472] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-613d19f4-eede-4ded-b67f-a6b5dae4cec4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.828036] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e27d75d1-404e-406a-a69e-4560bd02b4cc in Status: SUCCESS [ 950.828036] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e27d75d1-404e-406a-a69e-4560bd02b4cc" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.871187] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-f1ba8c13-9b99-414f-9c5a-c8efc1ebc191 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.871187] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f1ba8c13-9b99-414f-9c5a-c8efc1ebc191" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.871187] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f1ba8c13-9b99-414f-9c5a-c8efc1ebc191" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.871187] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f1ba8c13-9b99-414f-9c5a-c8efc1ebc191" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.871187] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.871187] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.871187] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.871919] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.872050] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.872277] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f1ba8c13-9b99-414f-9c5a-c8efc1ebc191" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.872538] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-f1ba8c13-9b99-414f-9c5a-c8efc1ebc191 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.873227] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f1ba8c13-9b99-414f-9c5a-c8efc1ebc191" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.873227] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f1ba8c13-9b99-414f-9c5a-c8efc1ebc191" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.873227] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f1ba8c13-9b99-414f-9c5a-c8efc1ebc191" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.874207] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.874207] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.874207] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.874207] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.874442] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.874619] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f1ba8c13-9b99-414f-9c5a-c8efc1ebc191" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.876856] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f1ba8c13-9b99-414f-9c5a-c8efc1ebc191',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.940925] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.941176] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.941241] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.941480] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.975354] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.976212] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.976212] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.976212] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.976212] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.976212] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.976440] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e889ce7-965a-4de0-b096-60d4e743cf8b is going to be updated. [ 951.036388] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.036580] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.036622] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.036860] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.037149] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.050703] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e889ce7-965a-4de0-b096-60d4e743cf8b in Status: IN_PROGRESS for 2s [ 951.055197] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 in Status: SUCCESS [ 951.055512] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 deletion is rescheduled due to dependency. [ 951.055615] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.055714] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.055952] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.056149] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.056277] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.056339] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.056516] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.056593] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.056694] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7db87dc2-69af-45f1-90c2-f8a4ec96c3b7',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.378355] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f1ba8c13-9b99-414f-9c5a-c8efc1ebc191: rpc.has_security_group_logging(os_id): False [ 951.398778] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.398951] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.398951] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.399183] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.399285] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.399566] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.399676] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.399736] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.399892] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.400014] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.400227] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.400323] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.400382] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.400526] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.400622] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.400853] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.400958] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.401082] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.401165] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.401275] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.401399] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f1ba8c13-9b99-414f-9c5a-c8efc1ebc191 is going to be created. [ 951.468702] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.469208] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.469305] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.469498] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.469672] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.480768] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f1ba8c13-9b99-414f-9c5a-c8efc1ebc191 in Status: IN_PROGRESS for 2s [ 951.562896] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7db87dc2-69af-45f1-90c2-f8a4ec96c3b7',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.068299] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7db87dc2-69af-45f1-90c2-f8a4ec96c3b7',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.570531] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.570773] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.570844] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.571157] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.571301] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.571422] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 is going to be updated. [ 952.607982] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.608296] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.608296] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.608440] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.608565] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.618885] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 in Status: IN_PROGRESS for 2s [ 953.064455] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e889ce7-965a-4de0-b096-60d4e743cf8b in Status: SUCCESS [ 953.064673] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e889ce7-965a-4de0-b096-60d4e743cf8b deletion is rescheduled due to dependency. [ 953.064797] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.344762] env[65337]: INFO networking_nsxv3.common.synchronization [None req-ef772478-cc92-4f85-86e6-3cffc6fa2cfa None None] Enqueued Resource ID: f7278065-c283-4407-ac2a-80d189fc62bd with Priority: HIGHEST for action port [ 953.345414] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7278065-c283-4407-ac2a-80d189fc62bd with Priority: HIGHEST for action port [ 953.345739] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-f7278065-c283-4407-ac2a-80d189fc62bd taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.345863] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f7278065-c283-4407-ac2a-80d189fc62bd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.345927] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f7278065-c283-4407-ac2a-80d189fc62bd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.348762] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f7278065-c283-4407-ac2a-80d189fc62bd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.348762] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f7278065-c283-4407-ac2a-80d189fc62bd',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.496927] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f1ba8c13-9b99-414f-9c5a-c8efc1ebc191 in Status: SUCCESS [ 953.496927] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f1ba8c13-9b99-414f-9c5a-c8efc1ebc191" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.853843] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f7278065-c283-4407-ac2a-80d189fc62bd [ 953.853843] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.853843] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.853843] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.853843] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.853843] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.853843] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f7278065-c283-4407-ac2a-80d189fc62bd already deleted. [ 953.853843] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f7278065-c283-4407-ac2a-80d189fc62bd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.434578] env[65337]: INFO networking_nsxv3.common.synchronization [None req-ab0ac56d-5871-4dca-bea6-1a4dfc081daf tempest-ServersV294TestFqdnHostnames-583565518 tempest-ServersV294TestFqdnHostnames-583565518-project-member] Enqueued Resource ID: a5a16fe4-8172-4f86-bfcd-dba6afcdd876 with Priority: HIGHEST for action security_group_rules [ 954.435152] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5a16fe4-8172-4f86-bfcd-dba6afcdd876 with Priority: HIGHEST for action security_group_rules [ 954.435441] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a5a16fe4-8172-4f86-bfcd-dba6afcdd876 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.435566] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a5a16fe4-8172-4f86-bfcd-dba6afcdd876" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.435633] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a5a16fe4-8172-4f86-bfcd-dba6afcdd876" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.436578] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a5a16fe4-8172-4f86-bfcd-dba6afcdd876" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.436578] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a5a16fe4-8172-4f86-bfcd-dba6afcdd876',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.566517] env[65337]: INFO networking_nsxv3.common.synchronization [None req-1437074d-4147-4601-b896-7838f50904c3 tempest-ServersV294TestFqdnHostnames-583565518 tempest-ServersV294TestFqdnHostnames-583565518-project-member] Enqueued Resource ID: a5a16fe4-8172-4f86-bfcd-dba6afcdd876 with Priority: HIGHEST for action security_group_rules [ 954.566517] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5a16fe4-8172-4f86-bfcd-dba6afcdd876 with Priority: HIGHEST for action security_group_rules [ 954.566517] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a5a16fe4-8172-4f86-bfcd-dba6afcdd876 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.566517] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a5a16fe4-8172-4f86-bfcd-dba6afcdd876" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.630982] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 in Status: SUCCESS [ 954.633696] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.633696] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.633696] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.633696] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.633696] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.633696] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.633696] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.633696] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.633696] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.633696] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7db87dc2-69af-45f1-90c2-f8a4ec96c3b7',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.749794] env[65337]: INFO networking_nsxv3.common.synchronization [req-3f555609-c3f5-4735-ba95-fb091dd9f80a req-475ee154-4c92-4b74-92cc-d738ef200115 tempest-ServerAddressesNegativeTestJSON-1173598156 tempest-ServerAddressesNegativeTestJSON-1173598156-project-member] Enqueued Resource ID: 8bec5c31-54b4-445a-a5e0-e51ba219c384 with Priority: HIGHEST for action security_group_members [ 954.750415] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8bec5c31-54b4-445a-a5e0-e51ba219c384 with Priority: HIGHEST for action security_group_members [ 954.750730] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bec5c31-54b4-445a-a5e0-e51ba219c384 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.750894] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bec5c31-54b4-445a-a5e0-e51ba219c384" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.750991] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bec5c31-54b4-445a-a5e0-e51ba219c384" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.751776] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bec5c31-54b4-445a-a5e0-e51ba219c384" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.751966] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.752128] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.752196] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.752399] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.752459] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.752529] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8bec5c31-54b4-445a-a5e0-e51ba219c384',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.963474] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.963474] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.963474] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.963474] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.963474] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.963474] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a5a16fe4-8172-4f86-bfcd-dba6afcdd876 already deleted. [ 954.963474] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a5a16fe4-8172-4f86-bfcd-dba6afcdd876" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.963474] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a5a16fe4-8172-4f86-bfcd-dba6afcdd876" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.963474] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a5a16fe4-8172-4f86-bfcd-dba6afcdd876" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.963474] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a5a16fe4-8172-4f86-bfcd-dba6afcdd876',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.137048] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.137286] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.137392] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.137740] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.138058] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.138264] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.138347] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.138554] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.138689] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.138972] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.139150] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.139360] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.139521] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.139758] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.140042] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.140193] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.140318] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.140622] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.140828] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.140980] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.141120] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7db87dc2-69af-45f1-90c2-f8a4ec96c3b7',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.256297] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.256297] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.256297] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.256744] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.256932] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.257146] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.257367] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.257430] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.257629] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.257766] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.257909] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8bec5c31-54b4-445a-a5e0-e51ba219c384 is going to be updated. [ 955.296941] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.297116] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.297174] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.297400] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.297820] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.300928] env[65337]: INFO networking_nsxv3.common.synchronization [None req-8f7571e9-8657-4e3d-b58f-49d15ace8676 tempest-ServerDiskConfigTestJSON-1745593668 tempest-ServerDiskConfigTestJSON-1745593668-project-member] Enqueued Resource ID: 6abea989-4c55-4d11-9761-bb3bf787bf57 with Priority: HIGHEST for action security_group_rules [ 955.301543] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6abea989-4c55-4d11-9761-bb3bf787bf57 with Priority: HIGHEST for action security_group_rules [ 955.301850] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6abea989-4c55-4d11-9761-bb3bf787bf57 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.302066] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6abea989-4c55-4d11-9761-bb3bf787bf57" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.302066] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6abea989-4c55-4d11-9761-bb3bf787bf57" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.302296] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6abea989-4c55-4d11-9761-bb3bf787bf57" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.302376] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6abea989-4c55-4d11-9761-bb3bf787bf57',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.307261] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8bec5c31-54b4-445a-a5e0-e51ba219c384 in Status: IN_PROGRESS for 2s [ 955.426734] env[65337]: INFO networking_nsxv3.common.synchronization [None req-21a7f9d6-2ec1-4852-818d-e9a33816a92a tempest-ServerDiskConfigTestJSON-1745593668 tempest-ServerDiskConfigTestJSON-1745593668-project-member] Enqueued Resource ID: 6abea989-4c55-4d11-9761-bb3bf787bf57 with Priority: HIGHEST for action security_group_rules [ 955.427349] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6abea989-4c55-4d11-9761-bb3bf787bf57 with Priority: HIGHEST for action security_group_rules [ 955.428328] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6abea989-4c55-4d11-9761-bb3bf787bf57 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.428509] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6abea989-4c55-4d11-9761-bb3bf787bf57" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.487414] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.488118] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.488118] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.488118] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.488118] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.488118] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a5a16fe4-8172-4f86-bfcd-dba6afcdd876 already deleted. [ 955.488118] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a5a16fe4-8172-4f86-bfcd-dba6afcdd876" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.645219] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7: rpc.has_security_group_logging(os_id): False [ 955.675397] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.675533] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.675533] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.675844] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.675844] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.677241] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.677453] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.677559] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.677847] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.677847] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.678149] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.678266] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.678382] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.678577] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.678691] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.679032] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.679032] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.679150] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.679264] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.679555] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.679678] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 is going to be updated. [ 955.754350] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.754534] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.754580] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.755071] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.755071] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.780324] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 in Status: IN_PROGRESS for 2s [ 955.845262] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.845517] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.845655] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.845982] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.846132] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.846297] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6abea989-4c55-4d11-9761-bb3bf787bf57 already deleted. [ 955.846418] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6abea989-4c55-4d11-9761-bb3bf787bf57" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.846770] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6abea989-4c55-4d11-9761-bb3bf787bf57" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.846770] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6abea989-4c55-4d11-9761-bb3bf787bf57" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.847015] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6abea989-4c55-4d11-9761-bb3bf787bf57',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.012950] env[65337]: INFO networking_nsxv3.common.synchronization [None req-b09f5e4f-85c4-4ba8-9f91-f935f9252aba None None] Enqueued Resource ID: 5eae0735-381b-4430-89aa-f22c80c4dd18 with Priority: HIGHEST for action port [ 956.013645] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5eae0735-381b-4430-89aa-f22c80c4dd18 with Priority: HIGHEST for action port [ 956.016922] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-5eae0735-381b-4430-89aa-f22c80c4dd18 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.017118] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5eae0735-381b-4430-89aa-f22c80c4dd18" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.017118] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5eae0735-381b-4430-89aa-f22c80c4dd18" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.019730] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5eae0735-381b-4430-89aa-f22c80c4dd18" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.021885] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5eae0735-381b-4430-89aa-f22c80c4dd18',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.372123] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.373414] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.373414] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.373414] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.373414] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.373414] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6abea989-4c55-4d11-9761-bb3bf787bf57 already deleted. [ 956.373414] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6abea989-4c55-4d11-9761-bb3bf787bf57" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.522917] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5eae0735-381b-4430-89aa-f22c80c4dd18 [ 956.523328] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.523473] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.523618] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.523770] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.524098] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.524098] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5eae0735-381b-4430-89aa-f22c80c4dd18 already deleted. [ 956.524098] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5eae0735-381b-4430-89aa-f22c80c4dd18" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.297434] env[65337]: INFO networking_nsxv3.common.synchronization [req-c73027a2-a5eb-49c5-aa1b-20d8aee21ffd req-2f1900b9-ca70-4553-ba5d-af820dbd23f4 tempest-AttachInterfacesTestJSON-1783062477 tempest-AttachInterfacesTestJSON-1783062477-project-member] Enqueued Resource ID: 94a13e53-dcf7-4643-ade4-8789dc9eabc4 with Priority: HIGHEST for action security_group_members [ 957.298067] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94a13e53-dcf7-4643-ade4-8789dc9eabc4 with Priority: HIGHEST for action security_group_members [ 957.298415] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-94a13e53-dcf7-4643-ade4-8789dc9eabc4 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.298543] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.298624] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.298821] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.299012] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.299122] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.299184] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.299364] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.299504] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.299584] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('94a13e53-dcf7-4643-ade4-8789dc9eabc4',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.328902] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8bec5c31-54b4-445a-a5e0-e51ba219c384 in Status: SUCCESS [ 957.330157] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8bec5c31-54b4-445a-a5e0-e51ba219c384 deletion is rescheduled due to dependency. [ 957.330157] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bec5c31-54b4-445a-a5e0-e51ba219c384" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.802248] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 in Status: SUCCESS [ 957.802248] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.802687] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('94a13e53-dcf7-4643-ade4-8789dc9eabc4',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.139925] env[65337]: INFO networking_nsxv3.common.synchronization [None req-6545cf10-c52d-40ee-95df-808df2461546 tempest-AttachInterfacesTestJSON-1783062477 tempest-AttachInterfacesTestJSON-1783062477-project-member] Enqueued Resource ID: 94a13e53-dcf7-4643-ade4-8789dc9eabc4 with Priority: HIGHEST for action security_group_members [ 958.140707] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94a13e53-dcf7-4643-ade4-8789dc9eabc4 with Priority: HIGHEST for action security_group_members [ 958.141171] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-94a13e53-dcf7-4643-ade4-8789dc9eabc4 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.141243] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.306768] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('94a13e53-dcf7-4643-ade4-8789dc9eabc4',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.812059] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.812059] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.812059] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.812059] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.812059] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.812059] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 94a13e53-dcf7-4643-ade4-8789dc9eabc4 is going to be updated. [ 958.876144] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.876338] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.876404] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.876636] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.876784] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.891962] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94a13e53-dcf7-4643-ade4-8789dc9eabc4 in Status: IN_PROGRESS for 2s [ 958.917589] env[65337]: INFO networking_nsxv3.common.synchronization [req-14f6b438-3d49-4c30-8085-061967adc11f req-7931cbe1-13c4-4054-b8da-fa6f8e46d0a6 tempest-ServerActionsTestOtherB-648353996 tempest-ServerActionsTestOtherB-648353996-project-member] Enqueued Resource ID: d4ff60fe-3407-42aa-b33c-6254779ad495 with Priority: HIGHEST for action security_group_members [ 958.918061] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4ff60fe-3407-42aa-b33c-6254779ad495 with Priority: HIGHEST for action security_group_members [ 958.918508] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4ff60fe-3407-42aa-b33c-6254779ad495 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.918508] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4ff60fe-3407-42aa-b33c-6254779ad495" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.918660] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4ff60fe-3407-42aa-b33c-6254779ad495" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.920732] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4ff60fe-3407-42aa-b33c-6254779ad495" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.920732] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.920830] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.920985] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.921409] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.921409] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.921409] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d4ff60fe-3407-42aa-b33c-6254779ad495',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.150684] env[65337]: INFO networking_nsxv3.common.synchronization [req-366aef7a-fa0f-4079-82ae-47a0f961d7c5 req-10005c9c-a73c-4e07-b09d-8a5c67be1e3c tempest-ListServerFiltersTestJSON-497303335 tempest-ListServerFiltersTestJSON-497303335-project-member] Enqueued Resource ID: c5bec24d-89af-4b5e-920b-dcaae02501f0 with Priority: HIGHEST for action security_group_members [ 959.151721] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5bec24d-89af-4b5e-920b-dcaae02501f0 with Priority: HIGHEST for action security_group_members [ 959.151721] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5bec24d-89af-4b5e-920b-dcaae02501f0 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.151721] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5bec24d-89af-4b5e-920b-dcaae02501f0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.151895] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5bec24d-89af-4b5e-920b-dcaae02501f0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.151966] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5bec24d-89af-4b5e-920b-dcaae02501f0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.152130] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.152230] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.152290] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.152461] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.152549] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.152642] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c5bec24d-89af-4b5e-920b-dcaae02501f0',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.397531] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock network-574 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.397769] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "network-574" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.397894] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "network-574" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.398219] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "network-574" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.398500] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.398721] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.398840] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.399256] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.399684] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.400151] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 959.400332] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 959.400455] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 959.400584] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 959.400727] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 959.400837] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 959.400970] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 959.424043] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.424247] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.424294] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.424541] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.424658] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.424862] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.425019] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.425106] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.425385] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.425500] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.425633] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d4ff60fe-3407-42aa-b33c-6254779ad495 is going to be updated. [ 959.436322] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 959.436500] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Cache value generated in 0.035 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 959.436636] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 959.436810] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "network-574" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.437204] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock port-b4b37ff4-285d-4bca-9c68-23d57b1c239b taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.437500] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "port-b4b37ff4-285d-4bca-9c68-23d57b1c239b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.437648] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "port-b4b37ff4-285d-4bca-9c68-23d57b1c239b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.438084] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "port-b4b37ff4-285d-4bca-9c68-23d57b1c239b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.438298] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b4b37ff4-285d-4bca-9c68-23d57b1c239b',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.465134] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.465360] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.465483] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.465739] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.465856] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.481101] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4ff60fe-3407-42aa-b33c-6254779ad495 in Status: IN_PROGRESS for 2s [ 959.590181] env[65337]: INFO networking_nsxv3.common.synchronization [req-02a7c507-7d91-41c3-ad5e-a62232a11686 req-63898039-18bf-4bdc-8e64-bad69ce76092 tempest-ServerDiskConfigTestJSON-1745593668 tempest-ServerDiskConfigTestJSON-1745593668-project-member] Enqueued Resource ID: 653446ea-2b31-43b8-a920-884274265c75 with Priority: HIGHEST for action security_group_members [ 959.590181] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 653446ea-2b31-43b8-a920-884274265c75 with Priority: HIGHEST for action security_group_members [ 959.590181] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-653446ea-2b31-43b8-a920-884274265c75 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.590470] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.590632] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.591020] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.591409] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.591862] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.592194] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.592539] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.594141] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.594141] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('653446ea-2b31-43b8-a920-884274265c75',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.655983] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c5bec24d-89af-4b5e-920b-dcaae02501f0',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.941478] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.941909] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.941909] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.942346] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.942414] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.942620] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Segment Port b4b37ff4-285d-4bca-9c68-23d57b1c239b not found, creating... [ 959.942874] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.943134] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.943288] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.943537] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.943672] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.944051] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.944272] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.944373] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.944596] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.944756] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.944901] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Resource: SegmentPort with ID: b4b37ff4-285d-4bca-9c68-23d57b1c239b is going to be created. [ 959.969878] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.970077] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.971033] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.971033] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.971033] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.971033] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "port-b4b37ff4-285d-4bca-9c68-23d57b1c239b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.096032] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.096243] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.096341] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.096625] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.096732] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.096999] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.097219] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.097219] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.097454] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.097640] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.097745] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 653446ea-2b31-43b8-a920-884274265c75 is going to be updated. [ 960.132920] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.133208] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.133208] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.133423] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.133579] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.149504] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 653446ea-2b31-43b8-a920-884274265c75 in Status: IN_PROGRESS for 2s [ 960.160216] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c5bec24d-89af-4b5e-920b-dcaae02501f0',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.665675] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.665876] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.665876] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.666909] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.666909] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.666909] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5bec24d-89af-4b5e-920b-dcaae02501f0 is going to be updated. [ 960.680983] env[65337]: INFO networking_nsxv3.common.synchronization [req-14f6b438-3d49-4c30-8085-061967adc11f req-7c90f694-76fe-40e5-8316-87c48e8cc78a service nova] Enqueued Resource ID: d4ff60fe-3407-42aa-b33c-6254779ad495 with Priority: HIGHEST for action security_group_rules [ 960.681251] env[65337]: INFO networking_nsxv3.common.synchronization [req-14f6b438-3d49-4c30-8085-061967adc11f req-7c90f694-76fe-40e5-8316-87c48e8cc78a service nova] Enqueued Resource ID: d4ff60fe-3407-42aa-b33c-6254779ad495 with Priority: HIGHEST for action security_group_members [ 960.681342] env[65337]: INFO networking_nsxv3.common.synchronization [req-14f6b438-3d49-4c30-8085-061967adc11f req-7c90f694-76fe-40e5-8316-87c48e8cc78a service nova] Enqueued Resource ID: b4b37ff4-285d-4bca-9c68-23d57b1c239b with Priority: HIGHEST for action port [ 960.681780] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4ff60fe-3407-42aa-b33c-6254779ad495 with Priority: HIGHEST for action security_group_rules [ 960.681780] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4ff60fe-3407-42aa-b33c-6254779ad495 with Priority: HIGHEST for action security_group_members [ 960.681780] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4b37ff4-285d-4bca-9c68-23d57b1c239b with Priority: HIGHEST for action port [ 960.682553] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d4ff60fe-3407-42aa-b33c-6254779ad495 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.682672] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d4ff60fe-3407-42aa-b33c-6254779ad495" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.682739] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d4ff60fe-3407-42aa-b33c-6254779ad495" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.682929] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d4ff60fe-3407-42aa-b33c-6254779ad495" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.683106] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d4ff60fe-3407-42aa-b33c-6254779ad495',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.684436] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4ff60fe-3407-42aa-b33c-6254779ad495 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.684564] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4ff60fe-3407-42aa-b33c-6254779ad495" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.684832] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-b4b37ff4-285d-4bca-9c68-23d57b1c239b taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.684959] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b4b37ff4-285d-4bca-9c68-23d57b1c239b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.684994] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b4b37ff4-285d-4bca-9c68-23d57b1c239b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.685407] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b4b37ff4-285d-4bca-9c68-23d57b1c239b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.685407] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b4b37ff4-285d-4bca-9c68-23d57b1c239b',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.695792] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.695931] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.696095] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.696330] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.696510] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.707598] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5bec24d-89af-4b5e-920b-dcaae02501f0 in Status: IN_PROGRESS for 2s [ 960.881652] env[65337]: INFO networking_nsxv3.common.synchronization [req-5566f3d7-ba33-445a-8548-5fc731143531 req-c0875ad0-9eff-4e18-a3d9-af1e3cb5b4eb tempest-AttachInterfacesTestJSON-1783062477 tempest-AttachInterfacesTestJSON-1783062477-project-member] Enqueued Resource ID: d72090eb-ca70-4a65-8186-a5f4b40ed4cd with Priority: HIGHEST for action security_group_members [ 960.883451] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d72090eb-ca70-4a65-8186-a5f4b40ed4cd with Priority: HIGHEST for action security_group_members [ 960.883451] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-d72090eb-ca70-4a65-8186-a5f4b40ed4cd taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.883451] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d72090eb-ca70-4a65-8186-a5f4b40ed4cd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.883451] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d72090eb-ca70-4a65-8186-a5f4b40ed4cd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.883451] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d72090eb-ca70-4a65-8186-a5f4b40ed4cd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.883451] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.883451] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.883812] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.883812] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.883812] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.884027] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d72090eb-ca70-4a65-8186-a5f4b40ed4cd',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.903671] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94a13e53-dcf7-4643-ade4-8789dc9eabc4 in Status: SUCCESS [ 960.903671] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.903671] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.903897] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.903952] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.904053] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.904113] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.904277] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.904359] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.904446] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('94a13e53-dcf7-4643-ade4-8789dc9eabc4',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.188168] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4ff60fe-3407-42aa-b33c-6254779ad495 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.188492] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4ff60fe-3407-42aa-b33c-6254779ad495" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.189396] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b4b37ff4-285d-4bca-9c68-23d57b1c239b with status ACTIVE [ 961.189694] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.189929] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.190100] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.190421] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.190602] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.190936] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.191118] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.191208] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.191432] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.191542] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.191801] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.192014] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.193599] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.193842] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.195108] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.195341] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b4b37ff4-285d-4bca-9c68-23d57b1c239b is going to be updated. [ 961.249440] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.249440] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.249440] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.249677] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.249808] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.249983] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b4b37ff4-285d-4bca-9c68-23d57b1c239b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.386538] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.386791] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.386905] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.387309] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.387412] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.387778] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.387946] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.388045] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.388305] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.389376] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.389376] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d72090eb-ca70-4a65-8186-a5f4b40ed4cd is going to be updated. [ 961.407053] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.407291] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.407384] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.407661] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.407768] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.408013] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.408159] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.408220] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.408404] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.408485] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.408594] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 94a13e53-dcf7-4643-ade4-8789dc9eabc4 is going to be updated. [ 961.414941] env[65337]: INFO networking_nsxv3.common.synchronization [req-2c7f1e3d-23f0-4e46-a745-66f563173e8d req-a2b516ba-8f79-4521-b087-e7bac3b89b92 tempest-ImagesNegativeTestJSON-78166556 tempest-ImagesNegativeTestJSON-78166556-project-member] Enqueued Resource ID: b11268ba-f3f9-4698-ae73-130361536d96 with Priority: HIGHEST for action security_group_members [ 961.415745] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b11268ba-f3f9-4698-ae73-130361536d96 with Priority: HIGHEST for action security_group_members [ 961.416058] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-b11268ba-f3f9-4698-ae73-130361536d96 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.416200] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b11268ba-f3f9-4698-ae73-130361536d96" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.416299] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b11268ba-f3f9-4698-ae73-130361536d96" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.416604] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b11268ba-f3f9-4698-ae73-130361536d96" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.416813] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.416934] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.416995] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.417193] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.417281] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.417379] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b11268ba-f3f9-4698-ae73-130361536d96',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.433732] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.433928] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.434351] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.434700] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.434907] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.450280] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d72090eb-ca70-4a65-8186-a5f4b40ed4cd in Status: IN_PROGRESS for 2s [ 961.463929] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.464180] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.464259] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.464473] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.464613] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.476038] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94a13e53-dcf7-4643-ade4-8789dc9eabc4 in Status: IN_PROGRESS for 2s [ 961.491685] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4ff60fe-3407-42aa-b33c-6254779ad495 in Status: SUCCESS [ 961.491912] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d4ff60fe-3407-42aa-b33c-6254779ad495 deletion is rescheduled due to dependency. [ 961.491987] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4ff60fe-3407-42aa-b33c-6254779ad495" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.492218] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4ff60fe-3407-42aa-b33c-6254779ad495" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.492444] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4ff60fe-3407-42aa-b33c-6254779ad495" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.492634] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.492752] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.492817] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.492964] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.493118] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.493236] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d4ff60fe-3407-42aa-b33c-6254779ad495',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.804246] env[65337]: INFO networking_nsxv3.common.synchronization [req-dbc63f36-f92f-484d-9bf6-44758f88eae3 req-e84400dc-b956-4dc2-bc14-bae10a8fb033 tempest-ServerTagsTestJSON-199911095 tempest-ServerTagsTestJSON-199911095-project-member] Enqueued Resource ID: f1ba8c13-9b99-414f-9c5a-c8efc1ebc191 with Priority: HIGHEST for action security_group_members [ 961.804835] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1ba8c13-9b99-414f-9c5a-c8efc1ebc191 with Priority: HIGHEST for action security_group_members [ 961.805228] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-f1ba8c13-9b99-414f-9c5a-c8efc1ebc191 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.805379] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f1ba8c13-9b99-414f-9c5a-c8efc1ebc191" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.805440] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f1ba8c13-9b99-414f-9c5a-c8efc1ebc191" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.805658] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f1ba8c13-9b99-414f-9c5a-c8efc1ebc191" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.805825] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.805963] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.806023] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.806196] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.806311] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.806411] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f1ba8c13-9b99-414f-9c5a-c8efc1ebc191',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.824666] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock network-21 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.824666] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "network-21" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.824666] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "network-21" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.824666] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "network-21" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.824666] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.824666] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.824666] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.824666] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.824666] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.824666] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 961.824666] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 961.824666] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 961.824666] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 961.825538] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 961.825538] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 961.825538] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 961.843319] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 961.843491] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 961.843624] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 961.843799] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "network-21" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.844131] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock port-932582f0-c8f9-4bde-9c95-be770aa6115a taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.844303] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "port-932582f0-c8f9-4bde-9c95-be770aa6115a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.844423] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "port-932582f0-c8f9-4bde-9c95-be770aa6115a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.844738] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "port-932582f0-c8f9-4bde-9c95-be770aa6115a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.844874] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('932582f0-c8f9-4bde-9c95-be770aa6115a',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.920606] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.920818] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.920921] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.921215] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.921354] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.921601] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.921768] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.921831] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.922102] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.922187] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.922409] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b11268ba-f3f9-4698-ae73-130361536d96 already deleted. [ 961.922409] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b11268ba-f3f9-4698-ae73-130361536d96" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.995927] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d4ff60fe-3407-42aa-b33c-6254779ad495',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.243329] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 653446ea-2b31-43b8-a920-884274265c75 in Status: SUCCESS [ 962.243329] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 653446ea-2b31-43b8-a920-884274265c75 deletion is rescheduled due to dependency. [ 962.243329] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.310885] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.310885] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.310885] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.310885] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.310885] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.310885] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.310885] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.310885] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.310885] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.310885] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.310885] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f1ba8c13-9b99-414f-9c5a-c8efc1ebc191 is going to be updated. [ 962.341165] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.341370] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.341415] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.341599] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.341744] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.347833] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.348090] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.348090] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.348332] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.348606] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.348606] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Segment Port 932582f0-c8f9-4bde-9c95-be770aa6115a not found, creating... [ 962.348878] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.349047] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.349224] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.349381] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.349517] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.349797] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.349951] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.350078] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.350293] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.351028] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.351028] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Resource: SegmentPort with ID: 932582f0-c8f9-4bde-9c95-be770aa6115a is going to be created. [ 962.353100] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f1ba8c13-9b99-414f-9c5a-c8efc1ebc191 in Status: IN_PROGRESS for 2s [ 962.371396] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.371603] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.371727] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.372009] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.372243] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.372473] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "port-932582f0-c8f9-4bde-9c95-be770aa6115a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.498466] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d4ff60fe-3407-42aa-b33c-6254779ad495',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.718694] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5bec24d-89af-4b5e-920b-dcaae02501f0 in Status: SUCCESS [ 962.718694] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5bec24d-89af-4b5e-920b-dcaae02501f0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.000232] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.000399] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.000469] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.000674] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.000763] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.000845] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d4ff60fe-3407-42aa-b33c-6254779ad495 is going to be updated. [ 963.033484] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.036151] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.036151] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.036151] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.036151] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.045102] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4ff60fe-3407-42aa-b33c-6254779ad495 in Status: IN_PROGRESS for 2s [ 963.153980] env[65337]: INFO networking_nsxv3.common.synchronization [req-2c7f1e3d-23f0-4e46-a745-66f563173e8d req-1ff14868-301c-4133-9080-41e650522a05 service nova] Enqueued Resource ID: b11268ba-f3f9-4698-ae73-130361536d96 with Priority: HIGHEST for action security_group_rules [ 963.154161] env[65337]: INFO networking_nsxv3.common.synchronization [req-2c7f1e3d-23f0-4e46-a745-66f563173e8d req-1ff14868-301c-4133-9080-41e650522a05 service nova] Enqueued Resource ID: b11268ba-f3f9-4698-ae73-130361536d96 with Priority: HIGHEST for action security_group_members [ 963.154301] env[65337]: INFO networking_nsxv3.common.synchronization [req-2c7f1e3d-23f0-4e46-a745-66f563173e8d req-1ff14868-301c-4133-9080-41e650522a05 service nova] Enqueued Resource ID: 932582f0-c8f9-4bde-9c95-be770aa6115a with Priority: HIGHEST for action port [ 963.154848] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b11268ba-f3f9-4698-ae73-130361536d96 with Priority: HIGHEST for action security_group_rules [ 963.154989] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b11268ba-f3f9-4698-ae73-130361536d96 with Priority: HIGHEST for action security_group_members [ 963.155701] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 932582f0-c8f9-4bde-9c95-be770aa6115a with Priority: HIGHEST for action port [ 963.156031] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b11268ba-f3f9-4698-ae73-130361536d96 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.156185] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b11268ba-f3f9-4698-ae73-130361536d96" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.156260] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b11268ba-f3f9-4698-ae73-130361536d96" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.156553] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b11268ba-f3f9-4698-ae73-130361536d96" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.156641] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b11268ba-f3f9-4698-ae73-130361536d96',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.157972] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-b11268ba-f3f9-4698-ae73-130361536d96 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.158289] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b11268ba-f3f9-4698-ae73-130361536d96" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.158289] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b11268ba-f3f9-4698-ae73-130361536d96" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.158414] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b11268ba-f3f9-4698-ae73-130361536d96" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.158628] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.158768] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.158859] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.159735] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.162636] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.162636] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b11268ba-f3f9-4698-ae73-130361536d96',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.163192] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-932582f0-c8f9-4bde-9c95-be770aa6115a taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.163320] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-932582f0-c8f9-4bde-9c95-be770aa6115a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.163421] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-932582f0-c8f9-4bde-9c95-be770aa6115a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.163702] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-932582f0-c8f9-4bde-9c95-be770aa6115a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.163702] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('932582f0-c8f9-4bde-9c95-be770aa6115a',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.460554] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d72090eb-ca70-4a65-8186-a5f4b40ed4cd in Status: SUCCESS [ 963.460830] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d72090eb-ca70-4a65-8186-a5f4b40ed4cd deletion is rescheduled due to dependency. [ 963.460874] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d72090eb-ca70-4a65-8186-a5f4b40ed4cd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.486714] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94a13e53-dcf7-4643-ade4-8789dc9eabc4 in Status: SUCCESS [ 963.486778] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 94a13e53-dcf7-4643-ade4-8789dc9eabc4 deletion is rescheduled due to dependency. [ 963.486874] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.666848] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b11268ba-f3f9-4698-ae73-130361536d96',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.668113] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-b11268ba-f3f9-4698-ae73-130361536d96 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.668113] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b11268ba-f3f9-4698-ae73-130361536d96" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.668461] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 932582f0-c8f9-4bde-9c95-be770aa6115a with status ACTIVE [ 963.668635] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.668906] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.668906] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.669117] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.669203] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.669391] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.669529] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.669609] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.669809] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.669898] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.670197] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.670271] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.670491] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.670491] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.670609] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.670609] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 932582f0-c8f9-4bde-9c95-be770aa6115a is going to be updated. [ 963.694636] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.694792] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.695033] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.695140] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.695225] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.695380] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-932582f0-c8f9-4bde-9c95-be770aa6115a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.169605] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b11268ba-f3f9-4698-ae73-130361536d96',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.362836] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f1ba8c13-9b99-414f-9c5a-c8efc1ebc191 in Status: SUCCESS [ 964.363048] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f1ba8c13-9b99-414f-9c5a-c8efc1ebc191 deletion is rescheduled due to dependency. [ 964.363135] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f1ba8c13-9b99-414f-9c5a-c8efc1ebc191" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.672507] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.672897] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.672897] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.672974] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.673027] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.673131] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b11268ba-f3f9-4698-ae73-130361536d96 is going to be created. [ 964.700072] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.700253] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.700329] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.700543] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.700710] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.710946] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b11268ba-f3f9-4698-ae73-130361536d96 in Status: UNINITIALIZED for 2s [ 965.056627] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4ff60fe-3407-42aa-b33c-6254779ad495 in Status: SUCCESS [ 965.056925] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4ff60fe-3407-42aa-b33c-6254779ad495" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.057161] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4ff60fe-3407-42aa-b33c-6254779ad495" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.057417] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4ff60fe-3407-42aa-b33c-6254779ad495" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.057718] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.057901] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.058098] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.058264] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.058383] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.058536] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4ff60fe-3407-42aa-b33c-6254779ad495" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.058687] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d4ff60fe-3407-42aa-b33c-6254779ad495',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.561294] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d4ff60fe-3407-42aa-b33c-6254779ad495',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.066637] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d4ff60fe-3407-42aa-b33c-6254779ad495: rpc.has_security_group_logging(os_id): False [ 966.092568] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.092793] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.092857] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.093174] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.093268] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.093631] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.093751] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.093815] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.094042] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.094130] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.094221] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d4ff60fe-3407-42aa-b33c-6254779ad495 is going to be updated. [ 966.163394] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.163572] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.163615] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.163793] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.163937] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.179831] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d4ff60fe-3407-42aa-b33c-6254779ad495 in Status: IN_PROGRESS for 2s [ 966.730224] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b11268ba-f3f9-4698-ae73-130361536d96 in Status: SUCCESS [ 966.730551] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b11268ba-f3f9-4698-ae73-130361536d96" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.730783] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b11268ba-f3f9-4698-ae73-130361536d96" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.731051] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b11268ba-f3f9-4698-ae73-130361536d96" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.731276] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.731394] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.731463] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.731665] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.731784] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.731850] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b11268ba-f3f9-4698-ae73-130361536d96" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.731943] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b11268ba-f3f9-4698-ae73-130361536d96',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.234792] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-b11268ba-f3f9-4698-ae73-130361536d96 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.235190] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b11268ba-f3f9-4698-ae73-130361536d96" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.235190] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b11268ba-f3f9-4698-ae73-130361536d96" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.235337] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b11268ba-f3f9-4698-ae73-130361536d96" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.235544] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.235652] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.235716] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.235905] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.236067] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.236104] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b11268ba-f3f9-4698-ae73-130361536d96" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.236317] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-b11268ba-f3f9-4698-ae73-130361536d96 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.236417] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b11268ba-f3f9-4698-ae73-130361536d96" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.236505] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b11268ba-f3f9-4698-ae73-130361536d96" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.236670] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b11268ba-f3f9-4698-ae73-130361536d96" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.236847] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.236951] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.237046] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.237204] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.237312] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.237404] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b11268ba-f3f9-4698-ae73-130361536d96" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.237510] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b11268ba-f3f9-4698-ae73-130361536d96',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.739744] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b11268ba-f3f9-4698-ae73-130361536d96: rpc.has_security_group_logging(os_id): False [ 967.758696] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.758881] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.758934] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.759144] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.759235] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.759429] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.759522] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.759586] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.759733] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.759809] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.759990] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.760116] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.760171] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.760304] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.760378] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.760570] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.760666] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.760727] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.760857] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.761124] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.761202] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b11268ba-f3f9-4698-ae73-130361536d96 is going to be created. [ 967.823841] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.824044] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.824087] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.824319] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.824526] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.838298] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b11268ba-f3f9-4698-ae73-130361536d96 in Status: IN_PROGRESS for 2s [ 968.157385] env[65337]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 968.157552] env[65337]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 968.197134] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d4ff60fe-3407-42aa-b33c-6254779ad495 in Status: SUCCESS [ 968.197400] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d4ff60fe-3407-42aa-b33c-6254779ad495" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.852409] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b11268ba-f3f9-4698-ae73-130361536d96 in Status: SUCCESS [ 969.852772] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b11268ba-f3f9-4698-ae73-130361536d96" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.158264] env[65337]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 973.158564] env[65337]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 973.676960] env[65337]: INFO networking_nsxv3.common.synchronization [None req-437b7465-aec6-48b6-b9de-7f6d7124263d None None] Enqueued Resource ID: fa3aa008-941d-4b14-9176-ae9f3c043248 with Priority: HIGHEST for action port [ 973.677927] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa3aa008-941d-4b14-9176-ae9f3c043248 with Priority: HIGHEST for action port [ 973.677927] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-fa3aa008-941d-4b14-9176-ae9f3c043248 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.677927] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fa3aa008-941d-4b14-9176-ae9f3c043248" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.677927] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fa3aa008-941d-4b14-9176-ae9f3c043248" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.677927] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fa3aa008-941d-4b14-9176-ae9f3c043248" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.678271] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fa3aa008-941d-4b14-9176-ae9f3c043248',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.182708] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fa3aa008-941d-4b14-9176-ae9f3c043248 [ 974.183061] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.184392] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.184392] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.184392] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.184392] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.184392] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fa3aa008-941d-4b14-9176-ae9f3c043248 already deleted. [ 974.184392] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fa3aa008-941d-4b14-9176-ae9f3c043248" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.249985] env[65337]: INFO networking_nsxv3.common.synchronization [None req-25b95770-7445-4abb-87de-d08534ea9980 None None] Enqueued Resource ID: 829b0dae-fbc8-4217-b00f-c2b66052e18a with Priority: HIGHEST for action port [ 974.250647] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 829b0dae-fbc8-4217-b00f-c2b66052e18a with Priority: HIGHEST for action port [ 974.251016] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-829b0dae-fbc8-4217-b00f-c2b66052e18a taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.251158] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-829b0dae-fbc8-4217-b00f-c2b66052e18a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.251230] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-829b0dae-fbc8-4217-b00f-c2b66052e18a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.251489] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-829b0dae-fbc8-4217-b00f-c2b66052e18a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.251592] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('829b0dae-fbc8-4217-b00f-c2b66052e18a',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.295870] env[65337]: INFO networking_nsxv3.common.synchronization [req-06999a2f-d115-4fe2-a7ab-0461a97028f4 req-5e5658e1-e2bb-4a6a-a8dc-2aa5c1f753f9 tempest-ServersV294TestFqdnHostnames-583565518 tempest-ServersV294TestFqdnHostnames-583565518-project-member] Enqueued Resource ID: a5a16fe4-8172-4f86-bfcd-dba6afcdd876 with Priority: HIGHEST for action security_group_members [ 974.296720] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5a16fe4-8172-4f86-bfcd-dba6afcdd876 with Priority: HIGHEST for action security_group_members [ 974.296720] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5a16fe4-8172-4f86-bfcd-dba6afcdd876 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.296870] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5a16fe4-8172-4f86-bfcd-dba6afcdd876" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.296938] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5a16fe4-8172-4f86-bfcd-dba6afcdd876" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.297219] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5a16fe4-8172-4f86-bfcd-dba6afcdd876" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.297575] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.297575] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.297575] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.298244] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.298244] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.298244] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a5a16fe4-8172-4f86-bfcd-dba6afcdd876',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.522018] env[65337]: INFO networking_nsxv3.common.synchronization [req-70f3b812-27aa-4e07-a9e6-bd25f242e165 req-fde6737e-5561-474c-ae10-0423f0db7658 tempest-ImagesTestJSON-1531636912 tempest-ImagesTestJSON-1531636912-project-member] Enqueued Resource ID: 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 with Priority: HIGHEST for action security_group_members [ 974.523584] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 with Priority: HIGHEST for action security_group_members [ 974.523932] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.524075] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.524143] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.524909] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.524909] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.524909] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.524909] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.524909] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.524909] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.525394] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7db87dc2-69af-45f1-90c2-f8a4ec96c3b7',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.749763] env[65337]: INFO networking_nsxv3.common.synchronization [req-79667ed1-3db5-4ccf-bb17-3949829c857d req-c30d81b3-c525-42e6-9c17-4a54d5e44f36 tempest-ServersNegativeTestJSON-62579270 tempest-ServersNegativeTestJSON-62579270-project-member] Enqueued Resource ID: b2e84376-5c9f-45e7-9949-59bf17a96c95 with Priority: HIGHEST for action security_group_members [ 974.751575] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2e84376-5c9f-45e7-9949-59bf17a96c95 with Priority: HIGHEST for action security_group_members [ 974.752297] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-b2e84376-5c9f-45e7-9949-59bf17a96c95 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.752297] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b2e84376-5c9f-45e7-9949-59bf17a96c95" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.752297] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b2e84376-5c9f-45e7-9949-59bf17a96c95" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.752694] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b2e84376-5c9f-45e7-9949-59bf17a96c95" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.752843] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.752945] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.753019] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.753183] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.753270] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.753365] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b2e84376-5c9f-45e7-9949-59bf17a96c95',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.754200] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 829b0dae-fbc8-4217-b00f-c2b66052e18a [ 974.756192] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.756192] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.756192] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.756192] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.756192] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.756192] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:829b0dae-fbc8-4217-b00f-c2b66052e18a already deleted. [ 974.756192] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-829b0dae-fbc8-4217-b00f-c2b66052e18a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.800074] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.800241] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.800310] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.800645] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.800645] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.800856] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.800923] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.800998] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.801112] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.801189] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.801270] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a5a16fe4-8172-4f86-bfcd-dba6afcdd876 already deleted. [ 974.801346] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5a16fe4-8172-4f86-bfcd-dba6afcdd876" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.033893] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.035229] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.035229] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.035229] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.035229] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.035685] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.035685] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.035685] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.035874] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.035874] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.035994] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 is going to be updated. [ 975.051028] env[65337]: INFO networking_nsxv3.common.synchronization [req-95ea8d19-07de-4959-a253-bd402583cd4a req-ca2a244d-49cc-491f-91a4-6389ed167678 tempest-ImagesNegativeTestJSON-78166556 tempest-ImagesNegativeTestJSON-78166556-project-member] Enqueued Resource ID: b11268ba-f3f9-4698-ae73-130361536d96 with Priority: HIGHEST for action security_group_members [ 975.051500] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b11268ba-f3f9-4698-ae73-130361536d96 with Priority: HIGHEST for action security_group_members [ 975.052077] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-b11268ba-f3f9-4698-ae73-130361536d96 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.052077] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b11268ba-f3f9-4698-ae73-130361536d96" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.052077] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b11268ba-f3f9-4698-ae73-130361536d96" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.052628] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b11268ba-f3f9-4698-ae73-130361536d96" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.053107] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.053107] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.053107] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.053256] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.053256] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.053350] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b11268ba-f3f9-4698-ae73-130361536d96',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.076318] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.077901] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.077901] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.077901] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.077901] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.087486] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 in Status: IN_PROGRESS for 2s [ 975.128944] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock network-987 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.128944] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "network-987" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.129134] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "network-987" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.129402] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "network-987" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.129668] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.129816] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.129926] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.130164] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.130300] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.130498] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 975.130602] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 975.130705] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 975.130802] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 975.130902] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 975.130997] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 975.132341] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 975.165862] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 975.166039] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Cache value generated in 0.035 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 975.166211] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 975.166445] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "network-987" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.168372] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock port-ad34e14b-8511-452f-9333-dd6221504b7e taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.168372] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "port-ad34e14b-8511-452f-9333-dd6221504b7e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.168372] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "port-ad34e14b-8511-452f-9333-dd6221504b7e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.168372] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "port-ad34e14b-8511-452f-9333-dd6221504b7e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.168372] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ad34e14b-8511-452f-9333-dd6221504b7e',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.256540] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.256856] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.256856] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.256977] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.257074] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.257269] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.257366] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.257420] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.257573] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.257641] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.257723] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b2e84376-5c9f-45e7-9949-59bf17a96c95 is going to be updated. [ 975.324301] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.325403] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.325403] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.325403] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.325403] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.333997] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b2e84376-5c9f-45e7-9949-59bf17a96c95 in Status: IN_PROGRESS for 2s [ 975.558127] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.558127] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.558127] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.558127] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.558127] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.558127] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.558127] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.558127] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.558127] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.558127] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.558127] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b11268ba-f3f9-4698-ae73-130361536d96 is going to be updated. [ 975.591013] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.591280] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.591333] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.591993] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.593931] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.604714] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b11268ba-f3f9-4698-ae73-130361536d96 in Status: IN_PROGRESS for 2s [ 975.670454] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.670564] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.670646] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.670971] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.671189] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.671431] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Segment Port ad34e14b-8511-452f-9333-dd6221504b7e not found, creating... [ 975.672575] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.672575] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.672575] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.672575] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.672575] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.672878] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.673025] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.673204] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.673509] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.673778] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.673948] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Resource: SegmentPort with ID: ad34e14b-8511-452f-9333-dd6221504b7e is going to be created. [ 975.695895] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.696602] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.696739] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.697036] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.697578] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.697772] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "port-ad34e14b-8511-452f-9333-dd6221504b7e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.849815] env[65337]: INFO networking_nsxv3.common.synchronization [req-6018d915-30cf-4c78-9df0-4ee7a6dec305 req-22840510-93d6-464b-9558-f09083678970 tempest-ServerDiskConfigTestJSON-1745593668 tempest-ServerDiskConfigTestJSON-1745593668-project-member] Enqueued Resource ID: 653446ea-2b31-43b8-a920-884274265c75 with Priority: HIGHEST for action security_group_members [ 975.850331] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 653446ea-2b31-43b8-a920-884274265c75 with Priority: HIGHEST for action security_group_members [ 975.850711] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-653446ea-2b31-43b8-a920-884274265c75 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.850838] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.851525] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.851525] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.851961] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.852102] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.852168] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.852340] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.852432] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.852530] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('653446ea-2b31-43b8-a920-884274265c75',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.252399] env[65337]: INFO networking_nsxv3.common.synchronization [None req-52fac554-8e50-457c-a3aa-49e831d27327 None None] Enqueued Resource ID: 8d507620-63c0-4614-8e25-886193fa3ff5 with Priority: HIGHEST for action port [ 976.252930] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d507620-63c0-4614-8e25-886193fa3ff5 with Priority: HIGHEST for action port [ 976.253256] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-8d507620-63c0-4614-8e25-886193fa3ff5 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.253569] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8d507620-63c0-4614-8e25-886193fa3ff5" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.253569] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8d507620-63c0-4614-8e25-886193fa3ff5" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.253916] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8d507620-63c0-4614-8e25-886193fa3ff5" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.253949] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8d507620-63c0-4614-8e25-886193fa3ff5',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.257889] env[65337]: INFO networking_nsxv3.common.synchronization [None req-411e1494-3ff7-4694-a5d2-97cf9b7f25f3 None None] Enqueued Resource ID: 55a7092a-0797-4609-8b6e-dd871795742d with Priority: HIGHEST for action port [ 976.258602] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55a7092a-0797-4609-8b6e-dd871795742d with Priority: HIGHEST for action port [ 976.258920] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-55a7092a-0797-4609-8b6e-dd871795742d taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.259250] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-55a7092a-0797-4609-8b6e-dd871795742d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.259315] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-55a7092a-0797-4609-8b6e-dd871795742d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.259553] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-55a7092a-0797-4609-8b6e-dd871795742d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.260020] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('55a7092a-0797-4609-8b6e-dd871795742d',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.355328] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.355508] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.355580] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.355799] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.355897] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.356117] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.356369] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.356369] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.357123] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.357251] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.357448] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 653446ea-2b31-43b8-a920-884274265c75 is going to be updated. [ 976.388660] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.388660] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.388660] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.388660] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.388660] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.397314] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 653446ea-2b31-43b8-a920-884274265c75 in Status: IN_PROGRESS for 2s [ 976.421312] env[65337]: INFO networking_nsxv3.common.synchronization [req-06999a2f-d115-4fe2-a7ab-0461a97028f4 req-58bfafbf-35f6-4599-9367-94a57895274a service nova] Enqueued Resource ID: a5a16fe4-8172-4f86-bfcd-dba6afcdd876 with Priority: HIGHEST for action security_group_rules [ 976.421312] env[65337]: INFO networking_nsxv3.common.synchronization [req-06999a2f-d115-4fe2-a7ab-0461a97028f4 req-58bfafbf-35f6-4599-9367-94a57895274a service nova] Enqueued Resource ID: a5a16fe4-8172-4f86-bfcd-dba6afcdd876 with Priority: HIGHEST for action security_group_members [ 976.421312] env[65337]: INFO networking_nsxv3.common.synchronization [req-06999a2f-d115-4fe2-a7ab-0461a97028f4 req-58bfafbf-35f6-4599-9367-94a57895274a service nova] Enqueued Resource ID: ad34e14b-8511-452f-9333-dd6221504b7e with Priority: HIGHEST for action port [ 976.421582] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5a16fe4-8172-4f86-bfcd-dba6afcdd876 with Priority: HIGHEST for action security_group_rules [ 976.421624] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5a16fe4-8172-4f86-bfcd-dba6afcdd876 with Priority: HIGHEST for action security_group_members [ 976.421692] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad34e14b-8511-452f-9333-dd6221504b7e with Priority: HIGHEST for action port [ 976.423357] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a5a16fe4-8172-4f86-bfcd-dba6afcdd876 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.423357] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a5a16fe4-8172-4f86-bfcd-dba6afcdd876" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.423357] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a5a16fe4-8172-4f86-bfcd-dba6afcdd876" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.423357] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a5a16fe4-8172-4f86-bfcd-dba6afcdd876" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.423357] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a5a16fe4-8172-4f86-bfcd-dba6afcdd876',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.423736] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5a16fe4-8172-4f86-bfcd-dba6afcdd876 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.423809] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5a16fe4-8172-4f86-bfcd-dba6afcdd876" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.423871] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5a16fe4-8172-4f86-bfcd-dba6afcdd876" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.424429] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5a16fe4-8172-4f86-bfcd-dba6afcdd876" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.429542] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.429542] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.429542] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.429542] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.429542] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.429542] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a5a16fe4-8172-4f86-bfcd-dba6afcdd876',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.429542] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-ad34e14b-8511-452f-9333-dd6221504b7e taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.429542] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ad34e14b-8511-452f-9333-dd6221504b7e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.429542] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ad34e14b-8511-452f-9333-dd6221504b7e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.429542] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ad34e14b-8511-452f-9333-dd6221504b7e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.429542] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ad34e14b-8511-452f-9333-dd6221504b7e',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.481311] env[65337]: INFO networking_nsxv3.common.synchronization [None req-8e799592-f06f-4d00-816b-4366e879e5fb tempest-AttachVolumeTestJSON-1666012690 tempest-AttachVolumeTestJSON-1666012690-project-member] Enqueued Resource ID: 6fd84ddb-97c2-4cc9-882e-251b1b1dd2f6 with Priority: HIGHEST for action security_group_rules [ 976.482252] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fd84ddb-97c2-4cc9-882e-251b1b1dd2f6 with Priority: HIGHEST for action security_group_rules [ 976.482252] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6fd84ddb-97c2-4cc9-882e-251b1b1dd2f6 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.482252] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6fd84ddb-97c2-4cc9-882e-251b1b1dd2f6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.482252] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6fd84ddb-97c2-4cc9-882e-251b1b1dd2f6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.482573] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6fd84ddb-97c2-4cc9-882e-251b1b1dd2f6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.482573] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6fd84ddb-97c2-4cc9-882e-251b1b1dd2f6',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.587980] env[65337]: INFO networking_nsxv3.common.synchronization [None req-7128a18e-a150-4154-915f-22475c4d4f44 tempest-AttachVolumeTestJSON-1666012690 tempest-AttachVolumeTestJSON-1666012690-project-member] Enqueued Resource ID: 6fd84ddb-97c2-4cc9-882e-251b1b1dd2f6 with Priority: HIGHEST for action security_group_rules [ 976.588978] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fd84ddb-97c2-4cc9-882e-251b1b1dd2f6 with Priority: HIGHEST for action security_group_rules [ 976.589363] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6fd84ddb-97c2-4cc9-882e-251b1b1dd2f6 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.589508] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6fd84ddb-97c2-4cc9-882e-251b1b1dd2f6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.756785] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8d507620-63c0-4614-8e25-886193fa3ff5 [ 976.757042] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.757152] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.757210] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.757434] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.757569] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.757647] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8d507620-63c0-4614-8e25-886193fa3ff5 already deleted. [ 976.757704] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8d507620-63c0-4614-8e25-886193fa3ff5" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.764137] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 55a7092a-0797-4609-8b6e-dd871795742d [ 976.764137] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.764137] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.764137] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.764137] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.764137] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.764137] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:55a7092a-0797-4609-8b6e-dd871795742d already deleted. [ 976.764137] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-55a7092a-0797-4609-8b6e-dd871795742d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.931108] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5a16fe4-8172-4f86-bfcd-dba6afcdd876 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.931329] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5a16fe4-8172-4f86-bfcd-dba6afcdd876" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.931618] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ad34e14b-8511-452f-9333-dd6221504b7e with status ACTIVE [ 976.931849] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.932019] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.932131] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.932384] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.932493] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.932675] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.932855] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.932963] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.933195] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.933321] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.933569] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.933683] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.934480] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.934480] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.937848] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.937972] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ad34e14b-8511-452f-9333-dd6221504b7e is going to be updated. [ 976.939208] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a5a16fe4-8172-4f86-bfcd-dba6afcdd876',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.964157] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.966044] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.966044] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.966044] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.966044] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.966044] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ad34e14b-8511-452f-9333-dd6221504b7e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.021180] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.021422] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.021422] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.021598] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.021714] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.021811] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6fd84ddb-97c2-4cc9-882e-251b1b1dd2f6 already deleted. [ 977.021894] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6fd84ddb-97c2-4cc9-882e-251b1b1dd2f6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.022068] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6fd84ddb-97c2-4cc9-882e-251b1b1dd2f6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.022232] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6fd84ddb-97c2-4cc9-882e-251b1b1dd2f6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.022316] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6fd84ddb-97c2-4cc9-882e-251b1b1dd2f6',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.100888] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 in Status: SUCCESS [ 977.101079] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 deletion is rescheduled due to dependency. [ 977.101281] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.200980] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock network-73 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.201206] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "network-73" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.201355] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "network-73" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.201560] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "network-73" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.201807] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.201952] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.202082] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.202293] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.202730] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.202730] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 977.202730] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 977.202909] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 977.202909] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 977.203043] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 977.203207] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 977.203401] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 977.221601] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 977.221771] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 977.221911] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 977.222096] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "network-73" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.222409] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock port-74a2511e-7ebc-4726-96f3-54d7fb456c88 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.222579] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "port-74a2511e-7ebc-4726-96f3-54d7fb456c88" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.222694] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "port-74a2511e-7ebc-4726-96f3-54d7fb456c88" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.222999] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "port-74a2511e-7ebc-4726-96f3-54d7fb456c88" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.223157] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('74a2511e-7ebc-4726-96f3-54d7fb456c88',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.348297] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b2e84376-5c9f-45e7-9949-59bf17a96c95 in Status: SUCCESS [ 977.348769] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b2e84376-5c9f-45e7-9949-59bf17a96c95 deletion is rescheduled due to dependency. [ 977.349307] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b2e84376-5c9f-45e7-9949-59bf17a96c95" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.445539] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a5a16fe4-8172-4f86-bfcd-dba6afcdd876',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.543722] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.543836] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.543914] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.544137] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.544230] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.544765] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6fd84ddb-97c2-4cc9-882e-251b1b1dd2f6 already deleted. [ 977.544765] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6fd84ddb-97c2-4cc9-882e-251b1b1dd2f6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.614725] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b11268ba-f3f9-4698-ae73-130361536d96 in Status: SUCCESS [ 977.614725] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b11268ba-f3f9-4698-ae73-130361536d96 deletion is rescheduled due to dependency. [ 977.614725] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b11268ba-f3f9-4698-ae73-130361536d96" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.725108] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.725264] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.725415] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.725743] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.725914] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.726081] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Segment Port 74a2511e-7ebc-4726-96f3-54d7fb456c88 not found, creating... [ 977.726352] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.726710] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.726710] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.726829] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.726984] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.727283] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.727440] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.727550] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.727751] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.727877] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.728048] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Resource: SegmentPort with ID: 74a2511e-7ebc-4726-96f3-54d7fb456c88 is going to be created. [ 977.747061] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.747294] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.747422] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.747795] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.748363] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.748363] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "port-74a2511e-7ebc-4726-96f3-54d7fb456c88" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.948554] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.948754] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.948806] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.949053] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.949159] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.949289] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a5a16fe4-8172-4f86-bfcd-dba6afcdd876 is going to be created. [ 977.979061] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.979061] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.979061] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.979263] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.979380] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.990965] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5a16fe4-8172-4f86-bfcd-dba6afcdd876 in Status: UNINITIALIZED for 2s [ 978.407511] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 653446ea-2b31-43b8-a920-884274265c75 in Status: SUCCESS [ 978.407889] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 653446ea-2b31-43b8-a920-884274265c75 deletion is rescheduled due to dependency. [ 978.407889] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.470155] env[65337]: INFO networking_nsxv3.common.synchronization [req-6018d915-30cf-4c78-9df0-4ee7a6dec305 req-b01800d5-1e4f-4cf2-b73a-aa92a3c3df14 service nova] Enqueued Resource ID: 653446ea-2b31-43b8-a920-884274265c75 with Priority: HIGHEST for action security_group_rules [ 978.470155] env[65337]: INFO networking_nsxv3.common.synchronization [req-6018d915-30cf-4c78-9df0-4ee7a6dec305 req-b01800d5-1e4f-4cf2-b73a-aa92a3c3df14 service nova] Enqueued Resource ID: 653446ea-2b31-43b8-a920-884274265c75 with Priority: HIGHEST for action security_group_members [ 978.470155] env[65337]: INFO networking_nsxv3.common.synchronization [req-6018d915-30cf-4c78-9df0-4ee7a6dec305 req-b01800d5-1e4f-4cf2-b73a-aa92a3c3df14 service nova] Enqueued Resource ID: 74a2511e-7ebc-4726-96f3-54d7fb456c88 with Priority: HIGHEST for action port [ 978.470731] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 653446ea-2b31-43b8-a920-884274265c75 with Priority: HIGHEST for action security_group_rules [ 978.471157] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 653446ea-2b31-43b8-a920-884274265c75 with Priority: HIGHEST for action security_group_members [ 978.471594] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74a2511e-7ebc-4726-96f3-54d7fb456c88 with Priority: HIGHEST for action port [ 978.473160] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-653446ea-2b31-43b8-a920-884274265c75 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.473160] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.473160] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.473160] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.474241] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('653446ea-2b31-43b8-a920-884274265c75',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.479030] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-653446ea-2b31-43b8-a920-884274265c75 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.479030] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.479030] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.479030] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.479030] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.479030] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.479030] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.479030] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.479030] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.479030] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('653446ea-2b31-43b8-a920-884274265c75',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.481154] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-74a2511e-7ebc-4726-96f3-54d7fb456c88 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.481283] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-74a2511e-7ebc-4726-96f3-54d7fb456c88" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.481346] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-74a2511e-7ebc-4726-96f3-54d7fb456c88" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.481493] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-74a2511e-7ebc-4726-96f3-54d7fb456c88" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.481573] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('74a2511e-7ebc-4726-96f3-54d7fb456c88',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.981934] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('653446ea-2b31-43b8-a920-884274265c75',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.983122] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 74a2511e-7ebc-4726-96f3-54d7fb456c88 with status ACTIVE [ 978.983245] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.983394] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.983472] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.983677] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.983768] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.983942] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.984065] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.984154] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.984359] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.984447] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.984669] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.984782] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.984886] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.985976] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.986084] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.986186] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 74a2511e-7ebc-4726-96f3-54d7fb456c88 is going to be updated. [ 978.987625] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-653446ea-2b31-43b8-a920-884274265c75 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.987726] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.009796] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.010010] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.010010] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.010303] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.010449] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.010611] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-74a2511e-7ebc-4726-96f3-54d7fb456c88" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.488885] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('653446ea-2b31-43b8-a920-884274265c75',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.991305] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.991478] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.991551] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.991766] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.991852] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.991947] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 653446ea-2b31-43b8-a920-884274265c75 is going to be updated. [ 980.003461] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5a16fe4-8172-4f86-bfcd-dba6afcdd876 in Status: SUCCESS [ 980.003679] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5a16fe4-8172-4f86-bfcd-dba6afcdd876" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.003831] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5a16fe4-8172-4f86-bfcd-dba6afcdd876" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.004054] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5a16fe4-8172-4f86-bfcd-dba6afcdd876" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.004243] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.004379] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.004463] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.004621] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.004701] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.004787] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5a16fe4-8172-4f86-bfcd-dba6afcdd876" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.004875] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a5a16fe4-8172-4f86-bfcd-dba6afcdd876',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.025677] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.025677] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.026018] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.026018] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.026147] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.037397] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 653446ea-2b31-43b8-a920-884274265c75 in Status: IN_PROGRESS for 2s [ 980.441855] env[65337]: INFO networking_nsxv3.common.synchronization [None req-fa1ebbea-7246-4bcc-b363-f6bba651cf1e tempest-AttachInterfacesTestJSON-1783062477 tempest-AttachInterfacesTestJSON-1783062477-project-member] Enqueued Resource ID: c62ada24-25f1-4b90-b0a4-d9a4254a91e6 with Priority: HIGHEST for action security_group_rules [ 980.442401] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c62ada24-25f1-4b90-b0a4-d9a4254a91e6 with Priority: HIGHEST for action security_group_rules [ 980.442705] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c62ada24-25f1-4b90-b0a4-d9a4254a91e6 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.442872] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c62ada24-25f1-4b90-b0a4-d9a4254a91e6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.442872] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c62ada24-25f1-4b90-b0a4-d9a4254a91e6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.443193] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c62ada24-25f1-4b90-b0a4-d9a4254a91e6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.443322] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c62ada24-25f1-4b90-b0a4-d9a4254a91e6',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.508835] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a5a16fe4-8172-4f86-bfcd-dba6afcdd876',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.522157] env[65337]: INFO networking_nsxv3.common.synchronization [req-88f395be-6d77-4766-acac-d7f5cdd74c15 req-99e213b1-b542-46c9-b788-e92a2295a6f8 tempest-ListServerFiltersTestJSON-497303335 tempest-ListServerFiltersTestJSON-497303335-project-member] Enqueued Resource ID: c5bec24d-89af-4b5e-920b-dcaae02501f0 with Priority: HIGHEST for action security_group_members [ 980.522157] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5bec24d-89af-4b5e-920b-dcaae02501f0 with Priority: HIGHEST for action security_group_members [ 980.523223] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5bec24d-89af-4b5e-920b-dcaae02501f0 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.523607] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5bec24d-89af-4b5e-920b-dcaae02501f0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.524057] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5bec24d-89af-4b5e-920b-dcaae02501f0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.524411] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5bec24d-89af-4b5e-920b-dcaae02501f0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.524842] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.525134] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.525326] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.525744] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.525965] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.526166] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c5bec24d-89af-4b5e-920b-dcaae02501f0',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.627222] env[65337]: INFO networking_nsxv3.common.synchronization [None req-af4fd9ab-cd51-4279-9d78-b4170a84ee4e tempest-AttachInterfacesTestJSON-1783062477 tempest-AttachInterfacesTestJSON-1783062477-project-member] Enqueued Resource ID: c62ada24-25f1-4b90-b0a4-d9a4254a91e6 with Priority: HIGHEST for action security_group_rules [ 980.627793] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c62ada24-25f1-4b90-b0a4-d9a4254a91e6 with Priority: HIGHEST for action security_group_rules [ 980.628092] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c62ada24-25f1-4b90-b0a4-d9a4254a91e6 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.628166] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c62ada24-25f1-4b90-b0a4-d9a4254a91e6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.965668] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.965843] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.965906] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.966123] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.966208] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.966311] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c62ada24-25f1-4b90-b0a4-d9a4254a91e6 already deleted. [ 980.966391] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c62ada24-25f1-4b90-b0a4-d9a4254a91e6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.966553] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c62ada24-25f1-4b90-b0a4-d9a4254a91e6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.966715] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c62ada24-25f1-4b90-b0a4-d9a4254a91e6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.966800] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c62ada24-25f1-4b90-b0a4-d9a4254a91e6',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.012517] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a5a16fe4-8172-4f86-bfcd-dba6afcdd876: rpc.has_security_group_logging(os_id): False [ 981.029065] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.029458] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.029458] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.029608] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.032482] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.032482] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.032482] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.032482] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.032482] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.032482] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.032482] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5bec24d-89af-4b5e-920b-dcaae02501f0 is going to be updated. [ 981.033996] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.034202] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.034202] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.034378] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.034461] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.034810] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.034937] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.035039] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.035246] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.035348] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.035458] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a5a16fe4-8172-4f86-bfcd-dba6afcdd876 is going to be created. [ 981.073959] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.074178] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.074178] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.074380] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.074528] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.085100] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5bec24d-89af-4b5e-920b-dcaae02501f0 in Status: IN_PROGRESS for 2s [ 981.136476] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.136675] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.136675] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.136892] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.137096] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.157268] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a5a16fe4-8172-4f86-bfcd-dba6afcdd876 in Status: IN_PROGRESS for 2s [ 981.489477] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.489659] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.489712] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.489927] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.490029] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.490127] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c62ada24-25f1-4b90-b0a4-d9a4254a91e6 already deleted. [ 981.490209] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c62ada24-25f1-4b90-b0a4-d9a4254a91e6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.048417] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 653446ea-2b31-43b8-a920-884274265c75 in Status: SUCCESS [ 982.048707] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.048979] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.049081] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.049213] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.049432] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.049432] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.051859] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.051859] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.051859] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.051859] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('653446ea-2b31-43b8-a920-884274265c75',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.557057] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-653446ea-2b31-43b8-a920-884274265c75 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.557267] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.557267] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.557407] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.557615] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.557721] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.557758] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.557919] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.558016] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.558124] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.558337] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-653446ea-2b31-43b8-a920-884274265c75 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.558458] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.558521] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.558672] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.558813] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.558938] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.558998] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.559113] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.559189] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.559270] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.559360] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('653446ea-2b31-43b8-a920-884274265c75',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.063758] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 653446ea-2b31-43b8-a920-884274265c75: rpc.has_security_group_logging(os_id): False [ 983.082294] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.082484] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.082484] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.082698] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.082834] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.083057] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.083218] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.083385] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.083573] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.083661] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.083861] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.084022] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.084139] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.084241] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.084322] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.084568] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.084721] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.084721] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.084834] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.084894] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.084948] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 653446ea-2b31-43b8-a920-884274265c75 is going to be updated. [ 983.096671] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5bec24d-89af-4b5e-920b-dcaae02501f0 in Status: SUCCESS [ 983.096671] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5bec24d-89af-4b5e-920b-dcaae02501f0 deletion is rescheduled due to dependency. [ 983.096671] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5bec24d-89af-4b5e-920b-dcaae02501f0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.153707] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.153895] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.153936] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.154531] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.154531] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.168809] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a5a16fe4-8172-4f86-bfcd-dba6afcdd876 in Status: SUCCESS [ 983.169060] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a5a16fe4-8172-4f86-bfcd-dba6afcdd876" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.171278] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 653446ea-2b31-43b8-a920-884274265c75 in Status: IN_PROGRESS for 2s [ 984.691244] env[65337]: INFO networking_nsxv3.common.synchronization [req-21780f1d-b0d1-40ec-8b69-f7d6e6120992 req-2df5c914-d9e8-4d04-a301-3a1e05391c3d tempest-DeleteServersTestJSON-1654690426 tempest-DeleteServersTestJSON-1654690426-project-member] Enqueued Resource ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d with Priority: HIGHEST for action security_group_members [ 984.691849] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d with Priority: HIGHEST for action security_group_members [ 984.692219] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-161889a4-32a2-48ee-8fb7-d2a961a4b28d taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.692350] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.692414] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.692615] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.692772] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.693092] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.693092] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.693092] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.693310] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.693428] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('161889a4-32a2-48ee-8fb7-d2a961a4b28d',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.190027] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 653446ea-2b31-43b8-a920-884274265c75 in Status: SUCCESS [ 985.190297] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.195844] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.195978] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.196082] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.196326] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.196422] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.196609] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.196710] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.196778] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.196922] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.197000] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.197125] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d is going to be updated. [ 985.226463] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.226655] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.226722] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.226917] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.227069] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.235443] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d in Status: IN_PROGRESS for 2s [ 986.521566] env[65337]: INFO networking_nsxv3.common.synchronization [req-e2d52565-a944-43d9-a34e-1373a32707c5 req-15231a82-7134-488b-99da-ab0ab811e60f tempest-ImagesOneServerNegativeTestJSON-1864647261 tempest-ImagesOneServerNegativeTestJSON-1864647261-project-member] Enqueued Resource ID: 12a747a0-2898-4059-bada-c453c5c41052 with Priority: HIGHEST for action security_group_members [ 986.522203] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12a747a0-2898-4059-bada-c453c5c41052 with Priority: HIGHEST for action security_group_members [ 986.522596] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-12a747a0-2898-4059-bada-c453c5c41052 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.522753] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12a747a0-2898-4059-bada-c453c5c41052" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.522841] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12a747a0-2898-4059-bada-c453c5c41052" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.523097] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12a747a0-2898-4059-bada-c453c5c41052" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.524018] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.524018] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.524018] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.524018] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.524018] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.524018] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('12a747a0-2898-4059-bada-c453c5c41052',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.871150] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock network-514 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.871425] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "network-514" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.871740] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "network-514" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.871812] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "network-514" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.872063] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.872250] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.872329] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.872554] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.872677] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.872912] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 986.873008] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 986.873121] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 986.873307] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 986.873307] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 986.873566] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 986.873566] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 986.895660] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 986.895834] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 986.896146] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 986.896146] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "network-514" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.896504] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock port-3ce97bb2-be41-49f6-8e0e-b304a55ff6b7 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.896689] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "port-3ce97bb2-be41-49f6-8e0e-b304a55ff6b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.896807] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "port-3ce97bb2-be41-49f6-8e0e-b304a55ff6b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.897155] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "port-3ce97bb2-be41-49f6-8e0e-b304a55ff6b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.897353] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3ce97bb2-be41-49f6-8e0e-b304a55ff6b7',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.027286] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.027286] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.027286] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.028181] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.028181] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.028287] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.028343] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.028389] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.028526] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.028605] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.028690] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12a747a0-2898-4059-bada-c453c5c41052 is going to be updated. [ 987.056771] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.056771] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.056771] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.056970] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.058478] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.070364] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12a747a0-2898-4059-bada-c453c5c41052 in Status: IN_PROGRESS for 2s [ 987.246422] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d in Status: SUCCESS [ 987.246603] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d deletion is rescheduled due to dependency. [ 987.246734] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.401229] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.401541] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.401730] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.402054] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.402242] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.402441] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Segment Port 3ce97bb2-be41-49f6-8e0e-b304a55ff6b7 not found, creating... [ 987.402714] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.402885] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.403012] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.403267] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.403408] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.403688] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.403843] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.403958] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.404183] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.404311] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.404452] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Resource: SegmentPort with ID: 3ce97bb2-be41-49f6-8e0e-b304a55ff6b7 is going to be created. [ 987.453925] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.454174] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.454303] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.454579] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.454809] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.455044] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "port-3ce97bb2-be41-49f6-8e0e-b304a55ff6b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.175740] env[65337]: INFO networking_nsxv3.common.synchronization [req-e2d52565-a944-43d9-a34e-1373a32707c5 req-5dc7d257-06a1-4760-81e5-af3d2e273ec5 service nova] Enqueued Resource ID: 12a747a0-2898-4059-bada-c453c5c41052 with Priority: HIGHEST for action security_group_rules [ 988.175988] env[65337]: INFO networking_nsxv3.common.synchronization [req-e2d52565-a944-43d9-a34e-1373a32707c5 req-5dc7d257-06a1-4760-81e5-af3d2e273ec5 service nova] Enqueued Resource ID: 12a747a0-2898-4059-bada-c453c5c41052 with Priority: HIGHEST for action security_group_members [ 988.176143] env[65337]: INFO networking_nsxv3.common.synchronization [req-e2d52565-a944-43d9-a34e-1373a32707c5 req-5dc7d257-06a1-4760-81e5-af3d2e273ec5 service nova] Enqueued Resource ID: 3ce97bb2-be41-49f6-8e0e-b304a55ff6b7 with Priority: HIGHEST for action port [ 988.176760] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12a747a0-2898-4059-bada-c453c5c41052 with Priority: HIGHEST for action security_group_rules [ 988.176910] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12a747a0-2898-4059-bada-c453c5c41052 with Priority: HIGHEST for action security_group_members [ 988.177015] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ce97bb2-be41-49f6-8e0e-b304a55ff6b7 with Priority: HIGHEST for action port [ 988.177294] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-12a747a0-2898-4059-bada-c453c5c41052 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.177431] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-12a747a0-2898-4059-bada-c453c5c41052" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.177485] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-12a747a0-2898-4059-bada-c453c5c41052" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.177669] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-12a747a0-2898-4059-bada-c453c5c41052" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.177756] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('12a747a0-2898-4059-bada-c453c5c41052',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.178577] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-12a747a0-2898-4059-bada-c453c5c41052 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.179252] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12a747a0-2898-4059-bada-c453c5c41052" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.179496] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-3ce97bb2-be41-49f6-8e0e-b304a55ff6b7 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.179618] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3ce97bb2-be41-49f6-8e0e-b304a55ff6b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.179701] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3ce97bb2-be41-49f6-8e0e-b304a55ff6b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.180502] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3ce97bb2-be41-49f6-8e0e-b304a55ff6b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.180502] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3ce97bb2-be41-49f6-8e0e-b304a55ff6b7',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.681598] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-12a747a0-2898-4059-bada-c453c5c41052 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.681882] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12a747a0-2898-4059-bada-c453c5c41052" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.684329] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3ce97bb2-be41-49f6-8e0e-b304a55ff6b7 with status ACTIVE [ 988.684526] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.684704] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.684704] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.684919] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.685010] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.685196] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.685371] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.685477] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.685589] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.685665] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.685844] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.685938] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.685998] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.686145] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.686221] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.686654] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3ce97bb2-be41-49f6-8e0e-b304a55ff6b7 is going to be updated. [ 988.709797] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.710021] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.710021] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.710205] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.710342] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.710503] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3ce97bb2-be41-49f6-8e0e-b304a55ff6b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.083138] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12a747a0-2898-4059-bada-c453c5c41052 in Status: SUCCESS [ 989.083384] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12a747a0-2898-4059-bada-c453c5c41052 deletion is rescheduled due to dependency. [ 989.083467] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12a747a0-2898-4059-bada-c453c5c41052" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.083604] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12a747a0-2898-4059-bada-c453c5c41052" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.083799] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12a747a0-2898-4059-bada-c453c5c41052" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.083986] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.084121] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.084185] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.084341] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.084423] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.084516] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('12a747a0-2898-4059-bada-c453c5c41052',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.587722] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('12a747a0-2898-4059-bada-c453c5c41052',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.793545] env[65337]: INFO networking_nsxv3.common.synchronization [req-ec10e0ab-8c27-4519-835b-1914e0421810 req-1be728e8-68ba-4c4c-88c2-718a8ed155a2 tempest-ServerActionsV293TestJSON-1489208508 tempest-ServerActionsV293TestJSON-1489208508-project-member] Enqueued Resource ID: 287fa792-d512-4fba-b686-899daae58d0e with Priority: HIGHEST for action security_group_members [ 989.794363] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 287fa792-d512-4fba-b686-899daae58d0e with Priority: HIGHEST for action security_group_members [ 989.794527] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-287fa792-d512-4fba-b686-899daae58d0e taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.796030] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-287fa792-d512-4fba-b686-899daae58d0e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.796030] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-287fa792-d512-4fba-b686-899daae58d0e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.796030] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-287fa792-d512-4fba-b686-899daae58d0e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.796030] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.796030] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.796030] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.796030] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.796030] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.796030] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('287fa792-d512-4fba-b686-899daae58d0e',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.854568] env[65337]: INFO networking_nsxv3.common.synchronization [req-931d58e5-0dfb-46de-8601-1f492f59c094 req-a21a8571-f94a-4101-92b7-ee01bcb8a61f tempest-ServersTestJSON-1910122825 tempest-ServersTestJSON-1910122825-project-member] Enqueued Resource ID: af1da677-d95a-4cec-95fa-b9208101b7dd with Priority: HIGHEST for action security_group_members [ 989.855138] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af1da677-d95a-4cec-95fa-b9208101b7dd with Priority: HIGHEST for action security_group_members [ 989.855589] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-af1da677-d95a-4cec-95fa-b9208101b7dd taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.855810] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.855895] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.856468] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.856624] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.856690] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.856726] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.857050] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.857050] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.857050] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('af1da677-d95a-4cec-95fa-b9208101b7dd',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.090604] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('12a747a0-2898-4059-bada-c453c5c41052',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.267597] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock network-48 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.267841] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "network-48" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.267982] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "network-48" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.268325] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "network-48" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.268610] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.269016] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.269016] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.269215] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.269369] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.269634] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 990.269759] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 990.269878] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 990.269990] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 990.270125] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 990.270235] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 990.270363] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 990.291644] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 990.291929] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 990.292177] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 990.292384] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "network-48" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.292703] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock port-8dcf54dd-a3d3-41cd-8234-9d81820d2800 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.292872] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "port-8dcf54dd-a3d3-41cd-8234-9d81820d2800" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.293041] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "port-8dcf54dd-a3d3-41cd-8234-9d81820d2800" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.293327] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "port-8dcf54dd-a3d3-41cd-8234-9d81820d2800" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.293458] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8dcf54dd-a3d3-41cd-8234-9d81820d2800',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.298338] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.298475] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.298586] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.298780] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.298878] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.299689] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.299822] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.299896] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.300075] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.300157] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.300272] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 287fa792-d512-4fba-b686-899daae58d0e is going to be updated. [ 990.326114] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.326273] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.326409] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.326616] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.326759] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.335781] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 287fa792-d512-4fba-b686-899daae58d0e in Status: IN_PROGRESS for 2s [ 990.359853] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('af1da677-d95a-4cec-95fa-b9208101b7dd',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.595186] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.595186] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.595186] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.595186] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.595186] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.595186] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12a747a0-2898-4059-bada-c453c5c41052 is going to be updated. [ 990.625711] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.625849] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.625921] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.626235] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.626360] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.635126] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12a747a0-2898-4059-bada-c453c5c41052 in Status: IN_PROGRESS for 2s [ 990.796408] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.796664] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.796767] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.797044] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.797195] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.797343] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Segment Port 8dcf54dd-a3d3-41cd-8234-9d81820d2800 not found, creating... [ 990.797594] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.797742] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.797858] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.798081] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.798218] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.798490] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.798657] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.798771] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.798969] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.799114] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.799250] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Resource: SegmentPort with ID: 8dcf54dd-a3d3-41cd-8234-9d81820d2800 is going to be created. [ 990.821789] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.822036] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.822123] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.822386] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.822643] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.822880] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "port-8dcf54dd-a3d3-41cd-8234-9d81820d2800" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.861622] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('af1da677-d95a-4cec-95fa-b9208101b7dd',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.363549] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.363717] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.363791] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.364013] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.364113] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.364213] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: af1da677-d95a-4cec-95fa-b9208101b7dd is going to be updated. [ 991.413349] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.413542] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.413542] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.413930] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.413930] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.423543] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af1da677-d95a-4cec-95fa-b9208101b7dd in Status: IN_PROGRESS for 2s [ 991.564082] env[65337]: INFO networking_nsxv3.common.synchronization [req-931d58e5-0dfb-46de-8601-1f492f59c094 req-677a07fa-9db3-4531-8705-41ffed9f40f2 service nova] Enqueued Resource ID: af1da677-d95a-4cec-95fa-b9208101b7dd with Priority: HIGHEST for action security_group_rules [ 991.565660] env[65337]: INFO networking_nsxv3.common.synchronization [req-931d58e5-0dfb-46de-8601-1f492f59c094 req-677a07fa-9db3-4531-8705-41ffed9f40f2 service nova] Enqueued Resource ID: af1da677-d95a-4cec-95fa-b9208101b7dd with Priority: HIGHEST for action security_group_members [ 991.565660] env[65337]: INFO networking_nsxv3.common.synchronization [req-931d58e5-0dfb-46de-8601-1f492f59c094 req-677a07fa-9db3-4531-8705-41ffed9f40f2 service nova] Enqueued Resource ID: 8dcf54dd-a3d3-41cd-8234-9d81820d2800 with Priority: HIGHEST for action port [ 991.565660] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af1da677-d95a-4cec-95fa-b9208101b7dd with Priority: HIGHEST for action security_group_rules [ 991.567125] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af1da677-d95a-4cec-95fa-b9208101b7dd with Priority: HIGHEST for action security_group_members [ 991.567281] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8dcf54dd-a3d3-41cd-8234-9d81820d2800 with Priority: HIGHEST for action port [ 991.567960] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-af1da677-d95a-4cec-95fa-b9208101b7dd taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.568128] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.568255] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.568476] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.568561] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('af1da677-d95a-4cec-95fa-b9208101b7dd',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.570103] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-af1da677-d95a-4cec-95fa-b9208101b7dd taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.570103] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.570793] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-8dcf54dd-a3d3-41cd-8234-9d81820d2800 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.570897] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8dcf54dd-a3d3-41cd-8234-9d81820d2800" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.571024] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8dcf54dd-a3d3-41cd-8234-9d81820d2800" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.571272] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8dcf54dd-a3d3-41cd-8234-9d81820d2800" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.571411] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8dcf54dd-a3d3-41cd-8234-9d81820d2800',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.074272] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-af1da677-d95a-4cec-95fa-b9208101b7dd taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.074671] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.074671] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8dcf54dd-a3d3-41cd-8234-9d81820d2800 with status ACTIVE [ 992.075839] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.075839] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.075839] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.075839] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.075839] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.075839] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.075839] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.076430] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.076430] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.076430] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.076430] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.076430] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.076627] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.076661] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.076815] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.076815] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8dcf54dd-a3d3-41cd-8234-9d81820d2800 is going to be updated. [ 992.103811] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.103811] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.104025] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.104065] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.104218] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.104515] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8dcf54dd-a3d3-41cd-8234-9d81820d2800" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.392354] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 287fa792-d512-4fba-b686-899daae58d0e in Status: SUCCESS [ 992.393032] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 287fa792-d512-4fba-b686-899daae58d0e deletion is rescheduled due to dependency. [ 992.393032] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-287fa792-d512-4fba-b686-899daae58d0e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.648834] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12a747a0-2898-4059-bada-c453c5c41052 in Status: SUCCESS [ 992.648834] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12a747a0-2898-4059-bada-c453c5c41052" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.648834] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12a747a0-2898-4059-bada-c453c5c41052" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.648834] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12a747a0-2898-4059-bada-c453c5c41052" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.648834] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.648834] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.648834] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.648834] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.648834] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.648834] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12a747a0-2898-4059-bada-c453c5c41052" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.648834] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('12a747a0-2898-4059-bada-c453c5c41052',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.151492] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-12a747a0-2898-4059-bada-c453c5c41052 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.151858] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12a747a0-2898-4059-bada-c453c5c41052" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.151858] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12a747a0-2898-4059-bada-c453c5c41052" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.153285] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12a747a0-2898-4059-bada-c453c5c41052" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.153285] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.153285] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.153285] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.153285] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.156703] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.156703] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12a747a0-2898-4059-bada-c453c5c41052" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.156703] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-12a747a0-2898-4059-bada-c453c5c41052 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.156703] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12a747a0-2898-4059-bada-c453c5c41052" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.156703] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12a747a0-2898-4059-bada-c453c5c41052" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.156703] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12a747a0-2898-4059-bada-c453c5c41052" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.156703] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.156703] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.156703] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.156703] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.156703] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.156703] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12a747a0-2898-4059-bada-c453c5c41052" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.156703] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('12a747a0-2898-4059-bada-c453c5c41052',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.433689] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af1da677-d95a-4cec-95fa-b9208101b7dd in Status: SUCCESS [ 993.433908] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.434117] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.434346] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.434526] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.434640] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.434703] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.434853] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.434934] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.435041] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('af1da677-d95a-4cec-95fa-b9208101b7dd',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.665021] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 12a747a0-2898-4059-bada-c453c5c41052: rpc.has_security_group_logging(os_id): False [ 993.688324] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.688324] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.688324] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.688799] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.688799] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.688910] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.689025] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.689084] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.691168] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.691168] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.691168] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.691168] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.691168] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.691168] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.691168] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.693801] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.693801] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.693801] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.694131] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.694195] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.694349] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 12a747a0-2898-4059-bada-c453c5c41052 is going to be updated. [ 993.793973] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.794217] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.794217] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.794390] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.794585] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.820686] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 12a747a0-2898-4059-bada-c453c5c41052 in Status: IN_PROGRESS for 2s [ 993.939313] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('af1da677-d95a-4cec-95fa-b9208101b7dd',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.440612] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('af1da677-d95a-4cec-95fa-b9208101b7dd',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.943013] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.943278] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.943392] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.943859] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.943859] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.943961] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: af1da677-d95a-4cec-95fa-b9208101b7dd is going to be updated. [ 994.978020] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.978020] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.978020] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.978020] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.978020] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.986249] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af1da677-d95a-4cec-95fa-b9208101b7dd in Status: IN_PROGRESS for 2s [ 995.837095] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 12a747a0-2898-4059-bada-c453c5c41052 in Status: SUCCESS [ 995.837420] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-12a747a0-2898-4059-bada-c453c5c41052" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.568848] env[65337]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 996.568848] env[65337]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 997.002262] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af1da677-d95a-4cec-95fa-b9208101b7dd in Status: SUCCESS [ 997.002262] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.002262] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.002262] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.002262] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.002893] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.002893] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.002893] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.002893] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.002893] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.002893] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('af1da677-d95a-4cec-95fa-b9208101b7dd',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.507266] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-af1da677-d95a-4cec-95fa-b9208101b7dd taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.507481] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.507481] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.507710] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.507848] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.508565] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.508565] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.508565] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.508565] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.508565] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.508565] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-af1da677-d95a-4cec-95fa-b9208101b7dd taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.508773] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.508773] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.508831] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.509082] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.509082] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.509221] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.509256] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.509333] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.509437] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.509491] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('af1da677-d95a-4cec-95fa-b9208101b7dd',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.013592] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for af1da677-d95a-4cec-95fa-b9208101b7dd: rpc.has_security_group_logging(os_id): False [ 998.035947] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.036133] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.036219] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.036606] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.036731] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.036942] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.037074] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.037750] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.037750] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.037750] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.037750] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.037922] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.037922] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.038280] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.038400] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.040073] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.040238] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.040312] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.040468] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.040547] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.040646] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: af1da677-d95a-4cec-95fa-b9208101b7dd is going to be updated. [ 998.123252] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.123499] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.123499] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.123706] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.123854] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.143491] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: af1da677-d95a-4cec-95fa-b9208101b7dd in Status: IN_PROGRESS for 2s [ 998.306886] env[65337]: INFO networking_nsxv3.common.synchronization [req-46feaa95-3080-49a2-b7f8-af3c393afde4 req-4154bdd4-57c0-484b-9ed8-c94bd43c6985 tempest-ServerMetadataTestJSON-464389734 tempest-ServerMetadataTestJSON-464389734-project-member] Enqueued Resource ID: 5e58c2df-9a0c-45bb-b4b3-676b4af3dc2c with Priority: HIGHEST for action security_group_members [ 998.307487] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e58c2df-9a0c-45bb-b4b3-676b4af3dc2c with Priority: HIGHEST for action security_group_members [ 998.308088] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e58c2df-9a0c-45bb-b4b3-676b4af3dc2c taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.308233] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e58c2df-9a0c-45bb-b4b3-676b4af3dc2c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.308307] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e58c2df-9a0c-45bb-b4b3-676b4af3dc2c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.308634] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e58c2df-9a0c-45bb-b4b3-676b4af3dc2c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.308911] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.308911] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.309664] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.309664] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.309664] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.309664] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e58c2df-9a0c-45bb-b4b3-676b4af3dc2c',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.811474] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.811693] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.811693] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.811973] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.812067] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.812226] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.812369] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.812407] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.812562] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.812638] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.812725] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e58c2df-9a0c-45bb-b4b3-676b4af3dc2c already deleted. [ 998.812808] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e58c2df-9a0c-45bb-b4b3-676b4af3dc2c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.977274] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock network-624 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.977521] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "network-624" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.977678] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "network-624" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.978139] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "network-624" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.978495] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.978735] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.978926] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.979287] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.979522] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.979839] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 998.980056] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 998.980380] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 998.980473] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 998.980918] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 998.980918] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 998.981064] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 999.004261] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 999.004433] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 999.004576] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 999.004765] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "network-624" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.005100] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock port-c72e23aa-c5f7-463c-8e91-882364e69498 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.005438] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "port-c72e23aa-c5f7-463c-8e91-882364e69498" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.005438] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "port-c72e23aa-c5f7-463c-8e91-882364e69498" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.005752] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "port-c72e23aa-c5f7-463c-8e91-882364e69498" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.005895] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c72e23aa-c5f7-463c-8e91-882364e69498',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.254306] env[65337]: INFO networking_nsxv3.common.synchronization [None req-a8a40e0a-d2b4-4eec-921b-5fcd9ebdf145 None None] Enqueued Resource ID: 82faa519-7fa9-495e-a96f-180f471d13df with Priority: HIGHEST for action port [ 999.254943] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82faa519-7fa9-495e-a96f-180f471d13df with Priority: HIGHEST for action port [ 999.255352] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-82faa519-7fa9-495e-a96f-180f471d13df taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.255447] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-82faa519-7fa9-495e-a96f-180f471d13df" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.255518] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-82faa519-7fa9-495e-a96f-180f471d13df" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.255956] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-82faa519-7fa9-495e-a96f-180f471d13df" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.256118] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('82faa519-7fa9-495e-a96f-180f471d13df',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.508508] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.508810] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.508999] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.509649] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.509885] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.510094] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Segment Port c72e23aa-c5f7-463c-8e91-882364e69498 not found, creating... [ 999.510375] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.510593] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.510658] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.510876] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.511085] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.511629] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.511629] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.511885] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.511970] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.512090] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.512228] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Resource: SegmentPort with ID: c72e23aa-c5f7-463c-8e91-882364e69498 is going to be created. [ 999.536271] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.536541] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.536689] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.536915] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.537161] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.537393] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "port-c72e23aa-c5f7-463c-8e91-882364e69498" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.760573] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 82faa519-7fa9-495e-a96f-180f471d13df [ 999.760573] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.760573] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.760573] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.760573] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.760573] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.760573] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:82faa519-7fa9-495e-a96f-180f471d13df already deleted. [ 999.760573] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-82faa519-7fa9-495e-a96f-180f471d13df" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.164343] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: af1da677-d95a-4cec-95fa-b9208101b7dd in Status: SUCCESS [ 1000.164574] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.211034] env[65337]: INFO networking_nsxv3.common.synchronization [req-a39bec7d-e098-4b2d-be35-ddea853f22e0 req-413a4e39-3bfc-4dde-afbe-2719a2168155 tempest-ImagesOneServerNegativeTestJSON-1864647261 tempest-ImagesOneServerNegativeTestJSON-1864647261-project-member] Enqueued Resource ID: 12a747a0-2898-4059-bada-c453c5c41052 with Priority: HIGHEST for action security_group_members [ 1000.211762] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12a747a0-2898-4059-bada-c453c5c41052 with Priority: HIGHEST for action security_group_members [ 1000.212121] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-12a747a0-2898-4059-bada-c453c5c41052 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.213243] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12a747a0-2898-4059-bada-c453c5c41052" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.213243] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12a747a0-2898-4059-bada-c453c5c41052" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.213243] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12a747a0-2898-4059-bada-c453c5c41052" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.213243] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.213243] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.213243] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.213243] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.213243] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.213243] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('12a747a0-2898-4059-bada-c453c5c41052',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.269111] env[65337]: INFO networking_nsxv3.common.synchronization [req-46feaa95-3080-49a2-b7f8-af3c393afde4 req-01ef85cf-89e4-4af9-8103-c0fdcc85d279 service nova] Enqueued Resource ID: 5e58c2df-9a0c-45bb-b4b3-676b4af3dc2c with Priority: HIGHEST for action security_group_rules [ 1000.269111] env[65337]: INFO networking_nsxv3.common.synchronization [req-46feaa95-3080-49a2-b7f8-af3c393afde4 req-01ef85cf-89e4-4af9-8103-c0fdcc85d279 service nova] Enqueued Resource ID: 5e58c2df-9a0c-45bb-b4b3-676b4af3dc2c with Priority: HIGHEST for action security_group_members [ 1000.269111] env[65337]: INFO networking_nsxv3.common.synchronization [req-46feaa95-3080-49a2-b7f8-af3c393afde4 req-01ef85cf-89e4-4af9-8103-c0fdcc85d279 service nova] Enqueued Resource ID: c72e23aa-c5f7-463c-8e91-882364e69498 with Priority: HIGHEST for action port [ 1000.269111] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e58c2df-9a0c-45bb-b4b3-676b4af3dc2c with Priority: HIGHEST for action security_group_rules [ 1000.269111] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e58c2df-9a0c-45bb-b4b3-676b4af3dc2c with Priority: HIGHEST for action security_group_members [ 1000.269111] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c72e23aa-c5f7-463c-8e91-882364e69498 with Priority: HIGHEST for action port [ 1000.269840] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5e58c2df-9a0c-45bb-b4b3-676b4af3dc2c taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.269840] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5e58c2df-9a0c-45bb-b4b3-676b4af3dc2c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.269840] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5e58c2df-9a0c-45bb-b4b3-676b4af3dc2c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.270565] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5e58c2df-9a0c-45bb-b4b3-676b4af3dc2c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.270565] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5e58c2df-9a0c-45bb-b4b3-676b4af3dc2c',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.271577] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e58c2df-9a0c-45bb-b4b3-676b4af3dc2c taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.271577] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e58c2df-9a0c-45bb-b4b3-676b4af3dc2c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.271577] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e58c2df-9a0c-45bb-b4b3-676b4af3dc2c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.273396] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e58c2df-9a0c-45bb-b4b3-676b4af3dc2c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.273396] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.273396] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.273396] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.273396] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.273396] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.273396] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e58c2df-9a0c-45bb-b4b3-676b4af3dc2c',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.273966] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-c72e23aa-c5f7-463c-8e91-882364e69498 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.274625] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c72e23aa-c5f7-463c-8e91-882364e69498" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.274625] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c72e23aa-c5f7-463c-8e91-882364e69498" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.274625] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c72e23aa-c5f7-463c-8e91-882364e69498" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.274625] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c72e23aa-c5f7-463c-8e91-882364e69498',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.671027] env[65337]: INFO networking_nsxv3.common.synchronization [req-a3a57bd4-fe72-4ae9-a573-4e97ab9b0d4b req-5d60e1ff-b4ba-462d-98f5-2cb2fe3cf939 tempest-AttachVolumeTestJSON-1666012690 tempest-AttachVolumeTestJSON-1666012690-project-member] Enqueued Resource ID: 6fd84ddb-97c2-4cc9-882e-251b1b1dd2f6 with Priority: HIGHEST for action security_group_members [ 1000.671027] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fd84ddb-97c2-4cc9-882e-251b1b1dd2f6 with Priority: HIGHEST for action security_group_members [ 1000.671027] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-6fd84ddb-97c2-4cc9-882e-251b1b1dd2f6 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.671027] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6fd84ddb-97c2-4cc9-882e-251b1b1dd2f6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.671027] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6fd84ddb-97c2-4cc9-882e-251b1b1dd2f6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.671027] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6fd84ddb-97c2-4cc9-882e-251b1b1dd2f6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.671027] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.671027] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.671027] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.671027] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.671027] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.671027] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6fd84ddb-97c2-4cc9-882e-251b1b1dd2f6',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.714945] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.715102] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.715178] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.715411] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.716027] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.716027] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.716027] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.716027] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.716027] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.716310] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.716310] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12a747a0-2898-4059-bada-c453c5c41052 is going to be updated. [ 1000.745929] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.746103] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.746154] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.747111] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.747111] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.755649] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12a747a0-2898-4059-bada-c453c5c41052 in Status: IN_PROGRESS for 2s [ 1000.772373] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e58c2df-9a0c-45bb-b4b3-676b4af3dc2c taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.772512] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e58c2df-9a0c-45bb-b4b3-676b4af3dc2c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.774933] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5e58c2df-9a0c-45bb-b4b3-676b4af3dc2c',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.777840] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c72e23aa-c5f7-463c-8e91-882364e69498 with status ACTIVE [ 1000.777948] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.778091] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.778171] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.778401] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.778495] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.778690] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.779130] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.779130] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.779355] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.779355] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.779517] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.779635] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.779729] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.779913] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.779983] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.780083] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c72e23aa-c5f7-463c-8e91-882364e69498 is going to be updated. [ 1000.811240] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.811240] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.811240] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.811240] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.811240] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.811240] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c72e23aa-c5f7-463c-8e91-882364e69498" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.066136] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock network-549 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.066136] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "network-549" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.066136] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "network-549" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.066136] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "network-549" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.066136] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.066136] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.066136] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.066597] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.066597] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.067431] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1001.067431] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1001.067431] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1001.067431] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1001.067431] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1001.067431] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1001.067431] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1001.088813] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1001.088813] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1001.088813] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1001.088813] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "network-549" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.088813] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock port-b62a8a5f-0603-4ac0-9675-3bb2b3389e1f taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.088813] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "port-b62a8a5f-0603-4ac0-9675-3bb2b3389e1f" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.088813] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "port-b62a8a5f-0603-4ac0-9675-3bb2b3389e1f" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.088813] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "port-b62a8a5f-0603-4ac0-9675-3bb2b3389e1f" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.089342] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b62a8a5f-0603-4ac0-9675-3bb2b3389e1f',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.172022] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.172209] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.172209] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.172373] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.172799] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.172799] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.172799] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.172799] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.172969] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.173015] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.173230] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6fd84ddb-97c2-4cc9-882e-251b1b1dd2f6 already deleted. [ 1001.173230] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6fd84ddb-97c2-4cc9-882e-251b1b1dd2f6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.277588] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5e58c2df-9a0c-45bb-b4b3-676b4af3dc2c',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.591810] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.592109] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.592239] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.592507] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.592658] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.592821] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Segment Port b62a8a5f-0603-4ac0-9675-3bb2b3389e1f not found, creating... [ 1001.593574] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.593574] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.593574] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.593574] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.593820] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.594026] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.594189] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.594316] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.594520] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.594733] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.594882] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Resource: SegmentPort with ID: b62a8a5f-0603-4ac0-9675-3bb2b3389e1f is going to be created. [ 1001.620184] env[65337]: INFO networking_nsxv3.common.synchronization [None req-411b5e2d-cb89-4b21-8573-8519e1de8ec2 None None] Enqueued Resource ID: 96862c09-ef27-4b28-bea1-b8ea6a60dcf2 with Priority: HIGHEST for action port [ 1001.621464] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.621608] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.621730] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.622048] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.622300] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.622515] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "port-b62a8a5f-0603-4ac0-9675-3bb2b3389e1f" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.623542] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96862c09-ef27-4b28-bea1-b8ea6a60dcf2 with Priority: HIGHEST for action port [ 1001.624035] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-96862c09-ef27-4b28-bea1-b8ea6a60dcf2 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.624141] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-96862c09-ef27-4b28-bea1-b8ea6a60dcf2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.624209] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-96862c09-ef27-4b28-bea1-b8ea6a60dcf2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.624449] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-96862c09-ef27-4b28-bea1-b8ea6a60dcf2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.624538] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('96862c09-ef27-4b28-bea1-b8ea6a60dcf2',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.780261] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.780428] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.780640] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.780710] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.780803] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.780901] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e58c2df-9a0c-45bb-b4b3-676b4af3dc2c is going to be created. [ 1001.811978] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.812252] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.812252] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.812463] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.812628] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.828921] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e58c2df-9a0c-45bb-b4b3-676b4af3dc2c in Status: UNINITIALIZED for 2s [ 1002.128111] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 96862c09-ef27-4b28-bea1-b8ea6a60dcf2 [ 1002.128748] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.128748] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.128748] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.129333] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.129333] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.129333] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:96862c09-ef27-4b28-bea1-b8ea6a60dcf2 already deleted. [ 1002.129333] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-96862c09-ef27-4b28-bea1-b8ea6a60dcf2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.364624] env[65337]: INFO networking_nsxv3.common.synchronization [req-a3a57bd4-fe72-4ae9-a573-4e97ab9b0d4b req-2beac92c-250c-40d7-970d-6b5185d2f2d7 service nova] Enqueued Resource ID: 6fd84ddb-97c2-4cc9-882e-251b1b1dd2f6 with Priority: HIGHEST for action security_group_rules [ 1002.364624] env[65337]: INFO networking_nsxv3.common.synchronization [req-a3a57bd4-fe72-4ae9-a573-4e97ab9b0d4b req-2beac92c-250c-40d7-970d-6b5185d2f2d7 service nova] Enqueued Resource ID: 6fd84ddb-97c2-4cc9-882e-251b1b1dd2f6 with Priority: HIGHEST for action security_group_members [ 1002.364624] env[65337]: INFO networking_nsxv3.common.synchronization [req-a3a57bd4-fe72-4ae9-a573-4e97ab9b0d4b req-2beac92c-250c-40d7-970d-6b5185d2f2d7 service nova] Enqueued Resource ID: b62a8a5f-0603-4ac0-9675-3bb2b3389e1f with Priority: HIGHEST for action port [ 1002.368598] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fd84ddb-97c2-4cc9-882e-251b1b1dd2f6 with Priority: HIGHEST for action security_group_rules [ 1002.368598] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fd84ddb-97c2-4cc9-882e-251b1b1dd2f6 with Priority: HIGHEST for action security_group_members [ 1002.368598] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b62a8a5f-0603-4ac0-9675-3bb2b3389e1f with Priority: HIGHEST for action port [ 1002.370076] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6fd84ddb-97c2-4cc9-882e-251b1b1dd2f6 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.370235] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6fd84ddb-97c2-4cc9-882e-251b1b1dd2f6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.370317] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6fd84ddb-97c2-4cc9-882e-251b1b1dd2f6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.370595] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6fd84ddb-97c2-4cc9-882e-251b1b1dd2f6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.370703] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6fd84ddb-97c2-4cc9-882e-251b1b1dd2f6',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.371799] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-6fd84ddb-97c2-4cc9-882e-251b1b1dd2f6 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.371949] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6fd84ddb-97c2-4cc9-882e-251b1b1dd2f6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.372039] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6fd84ddb-97c2-4cc9-882e-251b1b1dd2f6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.372222] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6fd84ddb-97c2-4cc9-882e-251b1b1dd2f6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.372392] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.372513] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.372588] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.372755] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.372863] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.372973] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6fd84ddb-97c2-4cc9-882e-251b1b1dd2f6',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.375162] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-b62a8a5f-0603-4ac0-9675-3bb2b3389e1f taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.375662] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b62a8a5f-0603-4ac0-9675-3bb2b3389e1f" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.375662] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b62a8a5f-0603-4ac0-9675-3bb2b3389e1f" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.375787] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b62a8a5f-0603-4ac0-9675-3bb2b3389e1f" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.375859] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b62a8a5f-0603-4ac0-9675-3bb2b3389e1f',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.429671] env[65337]: INFO networking_nsxv3.common.synchronization [None req-dd087dda-7201-406d-85fe-804cfa533c4c None None] Enqueued Resource ID: dff25440-1b95-4b17-8cf8-ee9204343fd7 with Priority: HIGHEST for action port [ 1002.430694] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dff25440-1b95-4b17-8cf8-ee9204343fd7 with Priority: HIGHEST for action port [ 1002.433205] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-dff25440-1b95-4b17-8cf8-ee9204343fd7 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.433205] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dff25440-1b95-4b17-8cf8-ee9204343fd7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.433205] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dff25440-1b95-4b17-8cf8-ee9204343fd7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.433205] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dff25440-1b95-4b17-8cf8-ee9204343fd7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.433205] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dff25440-1b95-4b17-8cf8-ee9204343fd7',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.531097] env[65337]: INFO networking_nsxv3.common.synchronization [None req-2e8e3edb-9847-4369-a3aa-51be4c1b13aa tempest-AttachVolumeShelveTestJSON-1101243143 tempest-AttachVolumeShelveTestJSON-1101243143-project-member] Enqueued Resource ID: 7b634dce-1340-436a-a5af-e7d03954de92 with Priority: HIGHEST for action security_group_rules [ 1002.531802] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b634dce-1340-436a-a5af-e7d03954de92 with Priority: HIGHEST for action security_group_rules [ 1002.532019] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7b634dce-1340-436a-a5af-e7d03954de92 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.532157] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7b634dce-1340-436a-a5af-e7d03954de92" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.532225] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7b634dce-1340-436a-a5af-e7d03954de92" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.532478] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7b634dce-1340-436a-a5af-e7d03954de92" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.532570] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7b634dce-1340-436a-a5af-e7d03954de92',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.698880] env[65337]: INFO networking_nsxv3.common.synchronization [None req-fa7f16b1-c325-42f0-a1ba-1aaf8643a4b4 tempest-AttachVolumeShelveTestJSON-1101243143 tempest-AttachVolumeShelveTestJSON-1101243143-project-member] Enqueued Resource ID: 7b634dce-1340-436a-a5af-e7d03954de92 with Priority: HIGHEST for action security_group_rules [ 1002.699879] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b634dce-1340-436a-a5af-e7d03954de92 with Priority: HIGHEST for action security_group_rules [ 1002.699879] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7b634dce-1340-436a-a5af-e7d03954de92 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.699879] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7b634dce-1340-436a-a5af-e7d03954de92" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.765874] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12a747a0-2898-4059-bada-c453c5c41052 in Status: SUCCESS [ 1002.766065] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12a747a0-2898-4059-bada-c453c5c41052 deletion is rescheduled due to dependency. [ 1002.766181] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12a747a0-2898-4059-bada-c453c5c41052" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.881500] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6fd84ddb-97c2-4cc9-882e-251b1b1dd2f6',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.881500] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-6fd84ddb-97c2-4cc9-882e-251b1b1dd2f6 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.881500] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6fd84ddb-97c2-4cc9-882e-251b1b1dd2f6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.881500] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b62a8a5f-0603-4ac0-9675-3bb2b3389e1f with status ACTIVE [ 1002.881500] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.881500] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.881500] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.881500] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.881500] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.881500] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.881500] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.881500] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.885453] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.885453] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.885453] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.885453] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.885453] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.885453] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.885453] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.885453] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b62a8a5f-0603-4ac0-9675-3bb2b3389e1f is going to be updated. [ 1002.912028] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.913138] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.913262] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.913503] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.913666] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.913855] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b62a8a5f-0603-4ac0-9675-3bb2b3389e1f" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.936947] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dff25440-1b95-4b17-8cf8-ee9204343fd7 [ 1002.937206] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.937348] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.937418] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.937643] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.937756] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.937856] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dff25440-1b95-4b17-8cf8-ee9204343fd7 already deleted. [ 1002.937940] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dff25440-1b95-4b17-8cf8-ee9204343fd7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.063290] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.063290] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.063290] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.063290] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.063290] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.063290] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7b634dce-1340-436a-a5af-e7d03954de92 already deleted. [ 1003.063290] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7b634dce-1340-436a-a5af-e7d03954de92" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.063290] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7b634dce-1340-436a-a5af-e7d03954de92" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.063290] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7b634dce-1340-436a-a5af-e7d03954de92" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.063290] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7b634dce-1340-436a-a5af-e7d03954de92',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.390352] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6fd84ddb-97c2-4cc9-882e-251b1b1dd2f6',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.586626] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.586626] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.586626] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.586854] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.586889] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.586976] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7b634dce-1340-436a-a5af-e7d03954de92 already deleted. [ 1003.587067] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7b634dce-1340-436a-a5af-e7d03954de92" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.843649] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e58c2df-9a0c-45bb-b4b3-676b4af3dc2c in Status: SUCCESS [ 1003.843649] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e58c2df-9a0c-45bb-b4b3-676b4af3dc2c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.843649] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e58c2df-9a0c-45bb-b4b3-676b4af3dc2c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.843649] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e58c2df-9a0c-45bb-b4b3-676b4af3dc2c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.843649] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.843649] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.843649] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.843649] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.843649] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.843649] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e58c2df-9a0c-45bb-b4b3-676b4af3dc2c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.843649] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5e58c2df-9a0c-45bb-b4b3-676b4af3dc2c',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.859035] env[65337]: INFO networking_nsxv3.common.synchronization [None req-f425b86f-15d3-4d01-bd57-26881e761e34 tempest-ServersTestJSON-380339010 tempest-ServersTestJSON-380339010-project-member] Enqueued Resource ID: 3d8e0751-3115-433f-8b5b-b20068b58d27 with Priority: HIGHEST for action security_group_rules [ 1003.861517] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d8e0751-3115-433f-8b5b-b20068b58d27 with Priority: HIGHEST for action security_group_rules [ 1003.861919] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3d8e0751-3115-433f-8b5b-b20068b58d27 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.862848] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3d8e0751-3115-433f-8b5b-b20068b58d27" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.862930] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3d8e0751-3115-433f-8b5b-b20068b58d27" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.863248] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3d8e0751-3115-433f-8b5b-b20068b58d27" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.863391] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3d8e0751-3115-433f-8b5b-b20068b58d27',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.892614] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.892780] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.892862] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.893185] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.893341] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.893341] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6fd84ddb-97c2-4cc9-882e-251b1b1dd2f6 is going to be created. [ 1003.923960] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.924136] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.924202] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.924831] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.924831] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.935921] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6fd84ddb-97c2-4cc9-882e-251b1b1dd2f6 in Status: UNINITIALIZED for 2s [ 1004.008082] env[65337]: INFO networking_nsxv3.common.synchronization [None req-cae3e33a-fa14-4e73-8d16-ebc2752015b0 tempest-ServersTestJSON-380339010 tempest-ServersTestJSON-380339010-project-member] Enqueued Resource ID: 3d8e0751-3115-433f-8b5b-b20068b58d27 with Priority: HIGHEST for action security_group_rules [ 1004.008082] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d8e0751-3115-433f-8b5b-b20068b58d27 with Priority: HIGHEST for action security_group_rules [ 1004.008082] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3d8e0751-3115-433f-8b5b-b20068b58d27 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.008082] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3d8e0751-3115-433f-8b5b-b20068b58d27" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.344750] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e58c2df-9a0c-45bb-b4b3-676b4af3dc2c taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.344894] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e58c2df-9a0c-45bb-b4b3-676b4af3dc2c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.344961] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e58c2df-9a0c-45bb-b4b3-676b4af3dc2c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.345215] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e58c2df-9a0c-45bb-b4b3-676b4af3dc2c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.345479] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.345576] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.345655] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.346554] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.348186] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.348186] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e58c2df-9a0c-45bb-b4b3-676b4af3dc2c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.348294] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e58c2df-9a0c-45bb-b4b3-676b4af3dc2c taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.348853] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e58c2df-9a0c-45bb-b4b3-676b4af3dc2c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.348853] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e58c2df-9a0c-45bb-b4b3-676b4af3dc2c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.348853] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e58c2df-9a0c-45bb-b4b3-676b4af3dc2c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.348853] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.352228] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.352228] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.352228] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.352228] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.352228] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e58c2df-9a0c-45bb-b4b3-676b4af3dc2c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.352228] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5e58c2df-9a0c-45bb-b4b3-676b4af3dc2c',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.388597] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.388597] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.388597] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.388767] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.389586] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.389586] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3d8e0751-3115-433f-8b5b-b20068b58d27 already deleted. [ 1004.389586] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3d8e0751-3115-433f-8b5b-b20068b58d27" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.389586] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3d8e0751-3115-433f-8b5b-b20068b58d27" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.389586] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3d8e0751-3115-433f-8b5b-b20068b58d27" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.389586] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3d8e0751-3115-433f-8b5b-b20068b58d27',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.856661] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5e58c2df-9a0c-45bb-b4b3-676b4af3dc2c: rpc.has_security_group_logging(os_id): False [ 1004.875266] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.875484] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.875594] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.875782] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.875849] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.876080] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.876171] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.876319] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.876901] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.876901] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.876901] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.876901] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.876901] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.877352] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.877352] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.877352] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.878219] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.878219] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.878219] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.878219] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.878414] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5e58c2df-9a0c-45bb-b4b3-676b4af3dc2c is going to be created. [ 1004.913535] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.913755] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.913846] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.914113] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.914225] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.914435] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3d8e0751-3115-433f-8b5b-b20068b58d27 already deleted. [ 1004.914435] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3d8e0751-3115-433f-8b5b-b20068b58d27" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.957950] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.958193] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.958324] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.958645] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.958934] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.978736] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5e58c2df-9a0c-45bb-b4b3-676b4af3dc2c in Status: IN_PROGRESS for 2s [ 1005.004328] env[65337]: INFO networking_nsxv3.common.synchronization [req-4a6a9c74-4769-4b72-8211-92d4df2b00cb req-a5aa208a-a0ec-4f50-9ba0-9e4ca78c7d72 tempest-AttachInterfacesTestJSON-1783062477 tempest-AttachInterfacesTestJSON-1783062477-project-member] Enqueued Resource ID: c62ada24-25f1-4b90-b0a4-d9a4254a91e6 with Priority: HIGHEST for action security_group_members [ 1005.004952] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c62ada24-25f1-4b90-b0a4-d9a4254a91e6 with Priority: HIGHEST for action security_group_members [ 1005.005449] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-c62ada24-25f1-4b90-b0a4-d9a4254a91e6 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.005636] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c62ada24-25f1-4b90-b0a4-d9a4254a91e6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.005859] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c62ada24-25f1-4b90-b0a4-d9a4254a91e6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.006424] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c62ada24-25f1-4b90-b0a4-d9a4254a91e6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.006680] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.006817] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.006817] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.007049] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.007121] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.007227] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c62ada24-25f1-4b90-b0a4-d9a4254a91e6',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.087901] env[65337]: INFO networking_nsxv3.common.synchronization [None req-a0ecdda3-38f3-444a-8b79-8d4d00d5c1f4 None None] Enqueued Resource ID: 1623ab6c-b2d6-45ed-92be-4eb42937479b with Priority: HIGHEST for action port [ 1005.088462] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1623ab6c-b2d6-45ed-92be-4eb42937479b with Priority: HIGHEST for action port [ 1005.088876] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-1623ab6c-b2d6-45ed-92be-4eb42937479b taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.089039] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1623ab6c-b2d6-45ed-92be-4eb42937479b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.089185] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1623ab6c-b2d6-45ed-92be-4eb42937479b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.089492] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1623ab6c-b2d6-45ed-92be-4eb42937479b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.089492] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1623ab6c-b2d6-45ed-92be-4eb42937479b',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.378843] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock network-250 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.379068] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "network-250" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.379204] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "network-250" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.379473] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "network-250" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.379727] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.379880] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.379996] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.384506] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.384667] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.384883] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1005.385012] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1005.385122] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1005.385230] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1005.385339] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1005.385522] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1005.385681] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1005.407966] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1005.408047] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1005.408171] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1005.408346] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "network-250" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.408663] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock port-c5a06042-7b69-40da-a67d-6be2c0d59568 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.408848] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "port-c5a06042-7b69-40da-a67d-6be2c0d59568" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.408969] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "port-c5a06042-7b69-40da-a67d-6be2c0d59568" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.409309] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "port-c5a06042-7b69-40da-a67d-6be2c0d59568" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.409447] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c5a06042-7b69-40da-a67d-6be2c0d59568',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.511602] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.511764] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.511831] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.512061] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.512189] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.512396] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.512487] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.513253] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.513253] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.513253] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.513253] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c62ada24-25f1-4b90-b0a4-d9a4254a91e6 already deleted. [ 1005.513253] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c62ada24-25f1-4b90-b0a4-d9a4254a91e6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.592397] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1623ab6c-b2d6-45ed-92be-4eb42937479b [ 1005.592650] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.592801] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.592872] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.593103] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.593193] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.593329] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1623ab6c-b2d6-45ed-92be-4eb42937479b already deleted. [ 1005.593329] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1623ab6c-b2d6-45ed-92be-4eb42937479b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.912855] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.912855] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.912855] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.913567] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.913567] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.913567] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Segment Port c5a06042-7b69-40da-a67d-6be2c0d59568 not found, creating... [ 1005.913567] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.913762] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.913762] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.913978] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.914132] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.914418] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.914569] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.914680] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.914885] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.915015] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.915179] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Resource: SegmentPort with ID: c5a06042-7b69-40da-a67d-6be2c0d59568 is going to be created. [ 1005.937798] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.938022] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.938148] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.938440] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.938718] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.938942] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "port-c5a06042-7b69-40da-a67d-6be2c0d59568" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.949296] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6fd84ddb-97c2-4cc9-882e-251b1b1dd2f6 in Status: SUCCESS [ 1005.949463] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6fd84ddb-97c2-4cc9-882e-251b1b1dd2f6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.949579] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6fd84ddb-97c2-4cc9-882e-251b1b1dd2f6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.949788] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6fd84ddb-97c2-4cc9-882e-251b1b1dd2f6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.949992] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.950138] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.950215] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.950390] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.950472] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.950554] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6fd84ddb-97c2-4cc9-882e-251b1b1dd2f6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.950658] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6fd84ddb-97c2-4cc9-882e-251b1b1dd2f6',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.998324] env[65337]: INFO networking_nsxv3.common.synchronization [req-57cef6b7-d23d-4132-91c8-3db1c104a9b5 req-f7c7442a-50a7-43b0-a416-bad9e991cdb3 tempest-ServersTestJSON-1910122825 tempest-ServersTestJSON-1910122825-project-member] Enqueued Resource ID: af1da677-d95a-4cec-95fa-b9208101b7dd with Priority: HIGHEST for action security_group_members [ 1006.002144] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af1da677-d95a-4cec-95fa-b9208101b7dd with Priority: HIGHEST for action security_group_members [ 1006.002144] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-af1da677-d95a-4cec-95fa-b9208101b7dd taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.002144] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.002144] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.002144] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.002144] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.002144] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.002144] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.002144] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.002144] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.002144] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('af1da677-d95a-4cec-95fa-b9208101b7dd',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.452833] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6fd84ddb-97c2-4cc9-882e-251b1b1dd2f6',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.505424] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('af1da677-d95a-4cec-95fa-b9208101b7dd',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.653515] env[65337]: INFO networking_nsxv3.common.synchronization [req-4a6a9c74-4769-4b72-8211-92d4df2b00cb req-261ff671-6556-4051-adb7-d1e24d825b07 service nova] Enqueued Resource ID: c62ada24-25f1-4b90-b0a4-d9a4254a91e6 with Priority: HIGHEST for action security_group_rules [ 1006.654106] env[65337]: INFO networking_nsxv3.common.synchronization [req-4a6a9c74-4769-4b72-8211-92d4df2b00cb req-261ff671-6556-4051-adb7-d1e24d825b07 service nova] Enqueued Resource ID: c62ada24-25f1-4b90-b0a4-d9a4254a91e6 with Priority: HIGHEST for action security_group_members [ 1006.654106] env[65337]: INFO networking_nsxv3.common.synchronization [req-4a6a9c74-4769-4b72-8211-92d4df2b00cb req-261ff671-6556-4051-adb7-d1e24d825b07 service nova] Enqueued Resource ID: c5a06042-7b69-40da-a67d-6be2c0d59568 with Priority: HIGHEST for action port [ 1006.656232] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c62ada24-25f1-4b90-b0a4-d9a4254a91e6 with Priority: HIGHEST for action security_group_rules [ 1006.657170] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c62ada24-25f1-4b90-b0a4-d9a4254a91e6 with Priority: HIGHEST for action security_group_members [ 1006.657170] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5a06042-7b69-40da-a67d-6be2c0d59568 with Priority: HIGHEST for action port [ 1006.658085] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c62ada24-25f1-4b90-b0a4-d9a4254a91e6 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.658288] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c62ada24-25f1-4b90-b0a4-d9a4254a91e6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.658364] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c62ada24-25f1-4b90-b0a4-d9a4254a91e6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.658628] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c62ada24-25f1-4b90-b0a4-d9a4254a91e6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.658767] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c62ada24-25f1-4b90-b0a4-d9a4254a91e6',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.659801] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-c62ada24-25f1-4b90-b0a4-d9a4254a91e6 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.659960] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c62ada24-25f1-4b90-b0a4-d9a4254a91e6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.660095] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c62ada24-25f1-4b90-b0a4-d9a4254a91e6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.660276] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c62ada24-25f1-4b90-b0a4-d9a4254a91e6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.660548] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.661242] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.661333] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.661487] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.661593] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.662108] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c62ada24-25f1-4b90-b0a4-d9a4254a91e6',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.663016] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-c5a06042-7b69-40da-a67d-6be2c0d59568 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.663138] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c5a06042-7b69-40da-a67d-6be2c0d59568" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.663222] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c5a06042-7b69-40da-a67d-6be2c0d59568" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.663429] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c5a06042-7b69-40da-a67d-6be2c0d59568" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.663514] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c5a06042-7b69-40da-a67d-6be2c0d59568',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.955624] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6fd84ddb-97c2-4cc9-882e-251b1b1dd2f6: rpc.has_security_group_logging(os_id): False [ 1006.973938] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.974151] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.974151] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.974293] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.974379] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.974616] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.974710] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.974771] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.974911] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.974985] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.975084] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6fd84ddb-97c2-4cc9-882e-251b1b1dd2f6 is going to be created. [ 1006.988261] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5e58c2df-9a0c-45bb-b4b3-676b4af3dc2c in Status: SUCCESS [ 1006.988443] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5e58c2df-9a0c-45bb-b4b3-676b4af3dc2c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.009086] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('af1da677-d95a-4cec-95fa-b9208101b7dd',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.033836] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.034016] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.034116] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.034282] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.034575] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.045845] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6fd84ddb-97c2-4cc9-882e-251b1b1dd2f6 in Status: IN_PROGRESS for 2s [ 1007.165911] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-c62ada24-25f1-4b90-b0a4-d9a4254a91e6 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.166244] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c62ada24-25f1-4b90-b0a4-d9a4254a91e6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.166244] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c5a06042-7b69-40da-a67d-6be2c0d59568 with status ACTIVE [ 1007.166430] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.166592] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.166592] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.166834] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.166948] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.167195] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.167301] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.167383] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.167570] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.167724] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.167862] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.167964] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.168040] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.168310] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.168380] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.168431] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c5a06042-7b69-40da-a67d-6be2c0d59568 is going to be updated. [ 1007.169813] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c62ada24-25f1-4b90-b0a4-d9a4254a91e6',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.197316] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.197496] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.197548] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.197764] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.197893] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.198078] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c5a06042-7b69-40da-a67d-6be2c0d59568" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.512063] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.512063] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.512201] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.512438] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.512558] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.512686] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: af1da677-d95a-4cec-95fa-b9208101b7dd is going to be updated. [ 1007.590522] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.590729] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.590729] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.590895] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.591099] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.601121] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af1da677-d95a-4cec-95fa-b9208101b7dd in Status: IN_PROGRESS for 2s [ 1007.673024] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c62ada24-25f1-4b90-b0a4-d9a4254a91e6',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.175518] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.175856] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.175856] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.176032] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.176168] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.176235] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c62ada24-25f1-4b90-b0a4-d9a4254a91e6 is going to be created. [ 1008.200355] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.200541] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.200587] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.200777] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.200989] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.215096] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c62ada24-25f1-4b90-b0a4-d9a4254a91e6 in Status: UNINITIALIZED for 2s [ 1008.584031] env[65337]: INFO networking_nsxv3.common.synchronization [req-231a6b1c-3656-4d51-a4cf-46eea4170c78 req-bfa2a9b8-1109-4db0-9e19-a80af77dd7c3 tempest-DeleteServersTestJSON-1654690426 tempest-DeleteServersTestJSON-1654690426-project-member] Enqueued Resource ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d with Priority: HIGHEST for action security_group_members [ 1008.584508] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d with Priority: HIGHEST for action security_group_members [ 1008.585016] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-161889a4-32a2-48ee-8fb7-d2a961a4b28d taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.585173] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.585265] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.585566] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.585774] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.585901] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.586015] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.586233] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.586671] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.586802] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('161889a4-32a2-48ee-8fb7-d2a961a4b28d',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.626197] env[65337]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-f81d39ac-7b08-4c21-a1c2-6484bc6252df None None] NSXv3 Agent Agent loop - iteration:1 completed [ 1008.626396] env[65337]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-f81d39ac-7b08-4c21-a1c2-6484bc6252df None None] NSXv3 Agent Agent loop - iteration:2 started [ 1008.922502] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock network-211 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.922502] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "network-211" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.922502] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "network-211" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.922502] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "network-211" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.922502] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.922502] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.922502] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.922502] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.923157] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.923284] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1008.923445] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1008.923546] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1008.923720] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1008.923848] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1008.923959] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1008.924115] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1008.955483] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1008.955483] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1008.955483] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1008.955483] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "network-211" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.955483] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock port-7451b1d4-53fe-48b6-afb6-2510d2d99a72 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.955483] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "port-7451b1d4-53fe-48b6-afb6-2510d2d99a72" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.955483] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "port-7451b1d4-53fe-48b6-afb6-2510d2d99a72" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.955483] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "port-7451b1d4-53fe-48b6-afb6-2510d2d99a72" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.955483] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7451b1d4-53fe-48b6-afb6-2510d2d99a72',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.064332] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6fd84ddb-97c2-4cc9-882e-251b1b1dd2f6 in Status: SUCCESS [ 1009.064573] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6fd84ddb-97c2-4cc9-882e-251b1b1dd2f6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.089253] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.089449] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.089605] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.089769] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.089862] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.090079] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.090193] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.090250] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.090752] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.090752] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.090752] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d is going to be updated. [ 1009.121189] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.121415] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.121465] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.121700] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.121881] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.133353] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d in Status: IN_PROGRESS for 2s [ 1009.460181] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.460569] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.460569] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.460801] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.460913] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.461093] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Segment Port 7451b1d4-53fe-48b6-afb6-2510d2d99a72 not found, creating... [ 1009.461364] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.461517] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.461626] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.461836] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.461967] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.462261] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.462404] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.462516] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.462702] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.462822] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.462951] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Resource: SegmentPort with ID: 7451b1d4-53fe-48b6-afb6-2510d2d99a72 is going to be created. [ 1009.485523] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.486078] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.486483] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.486763] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.487122] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.487552] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "port-7451b1d4-53fe-48b6-afb6-2510d2d99a72" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.613450] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af1da677-d95a-4cec-95fa-b9208101b7dd in Status: SUCCESS [ 1009.613450] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.221550] env[65337]: INFO networking_nsxv3.common.synchronization [req-231a6b1c-3656-4d51-a4cf-46eea4170c78 req-d1c6796b-9f8c-4ca9-85c6-dfd36f4293db service nova] Enqueued Resource ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d with Priority: HIGHEST for action security_group_rules [ 1010.221795] env[65337]: INFO networking_nsxv3.common.synchronization [req-231a6b1c-3656-4d51-a4cf-46eea4170c78 req-d1c6796b-9f8c-4ca9-85c6-dfd36f4293db service nova] Enqueued Resource ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d with Priority: HIGHEST for action security_group_members [ 1010.221906] env[65337]: INFO networking_nsxv3.common.synchronization [req-231a6b1c-3656-4d51-a4cf-46eea4170c78 req-d1c6796b-9f8c-4ca9-85c6-dfd36f4293db service nova] Enqueued Resource ID: 7451b1d4-53fe-48b6-afb6-2510d2d99a72 with Priority: HIGHEST for action port [ 1010.222502] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d with Priority: HIGHEST for action security_group_rules [ 1010.222652] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d with Priority: HIGHEST for action security_group_members [ 1010.222753] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7451b1d4-53fe-48b6-afb6-2510d2d99a72 with Priority: HIGHEST for action port [ 1010.223340] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-161889a4-32a2-48ee-8fb7-d2a961a4b28d taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.223457] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.223508] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.223758] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.223842] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('161889a4-32a2-48ee-8fb7-d2a961a4b28d',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.226816] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-161889a4-32a2-48ee-8fb7-d2a961a4b28d taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.226929] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.227843] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-7451b1d4-53fe-48b6-afb6-2510d2d99a72 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.228025] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7451b1d4-53fe-48b6-afb6-2510d2d99a72" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.228128] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7451b1d4-53fe-48b6-afb6-2510d2d99a72" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.228602] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7451b1d4-53fe-48b6-afb6-2510d2d99a72" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.228722] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7451b1d4-53fe-48b6-afb6-2510d2d99a72',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.230327] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c62ada24-25f1-4b90-b0a4-d9a4254a91e6 in Status: UNINITIALIZED for 4s [ 1010.731261] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-161889a4-32a2-48ee-8fb7-d2a961a4b28d taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.731549] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.732748] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7451b1d4-53fe-48b6-afb6-2510d2d99a72 with status ACTIVE [ 1010.732985] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.733127] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.733195] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.733431] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.733530] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.733711] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.733829] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.733899] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.734089] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.734173] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.734372] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.734475] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.734539] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.734674] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.734745] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.734825] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7451b1d4-53fe-48b6-afb6-2510d2d99a72 is going to be updated. [ 1010.757394] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.757599] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.757656] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.757862] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.758038] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.758303] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7451b1d4-53fe-48b6-afb6-2510d2d99a72" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.142793] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d in Status: SUCCESS [ 1011.143043] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d deletion is rescheduled due to dependency. [ 1011.143145] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.143288] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.143496] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.143681] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.143787] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.143836] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.143995] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.144091] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.144423] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('161889a4-32a2-48ee-8fb7-d2a961a4b28d',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.647050] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('161889a4-32a2-48ee-8fb7-d2a961a4b28d',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.150639] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('161889a4-32a2-48ee-8fb7-d2a961a4b28d',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.239855] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c62ada24-25f1-4b90-b0a4-d9a4254a91e6 in Status: SUCCESS [ 1012.240130] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c62ada24-25f1-4b90-b0a4-d9a4254a91e6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.241237] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c62ada24-25f1-4b90-b0a4-d9a4254a91e6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.241237] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c62ada24-25f1-4b90-b0a4-d9a4254a91e6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.241237] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.241237] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.241237] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.241237] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.241237] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.241237] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c62ada24-25f1-4b90-b0a4-d9a4254a91e6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.241744] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c62ada24-25f1-4b90-b0a4-d9a4254a91e6',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.653742] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.653900] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.653966] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.654200] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.654291] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.654391] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d is going to be updated. [ 1012.682060] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.682234] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.682304] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.683498] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.683498] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.691459] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d in Status: IN_PROGRESS for 2s [ 1012.743420] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c62ada24-25f1-4b90-b0a4-d9a4254a91e6',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.245468] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c62ada24-25f1-4b90-b0a4-d9a4254a91e6: rpc.has_security_group_logging(os_id): False [ 1013.263834] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.263997] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.264058] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.264293] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.264369] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.264599] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.264699] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.264753] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.264902] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.264975] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.265073] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c62ada24-25f1-4b90-b0a4-d9a4254a91e6 is going to be created. [ 1013.336677] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.336840] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.336908] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.337174] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.337344] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.361826] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c62ada24-25f1-4b90-b0a4-d9a4254a91e6 in Status: IN_PROGRESS for 2s [ 1014.702710] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d in Status: SUCCESS [ 1014.702710] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.702710] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.703132] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.703132] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.703238] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.703238] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.704258] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.704258] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.704258] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.704258] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('161889a4-32a2-48ee-8fb7-d2a961a4b28d',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.206813] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-161889a4-32a2-48ee-8fb7-d2a961a4b28d taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.207064] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.207064] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.207295] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.207469] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.207584] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.207627] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.207783] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.207847] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.207960] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.208164] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-161889a4-32a2-48ee-8fb7-d2a961a4b28d taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.208371] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.208425] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.208544] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.208726] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.208798] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.208798] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.208974] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.209045] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.209136] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.209242] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('161889a4-32a2-48ee-8fb7-d2a961a4b28d',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.213627] env[65337]: INFO networking_nsxv3.common.synchronization [req-fb529a78-57f9-4744-ae80-9f92b68e8683 req-e01cfd7c-ca3b-4b29-9878-96687027a506 tempest-ServerMetadataTestJSON-464389734 tempest-ServerMetadataTestJSON-464389734-project-member] Enqueued Resource ID: 5e58c2df-9a0c-45bb-b4b3-676b4af3dc2c with Priority: HIGHEST for action security_group_members [ 1015.214182] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e58c2df-9a0c-45bb-b4b3-676b4af3dc2c with Priority: HIGHEST for action security_group_members [ 1015.214495] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e58c2df-9a0c-45bb-b4b3-676b4af3dc2c taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.214639] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e58c2df-9a0c-45bb-b4b3-676b4af3dc2c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.215195] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e58c2df-9a0c-45bb-b4b3-676b4af3dc2c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.215497] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e58c2df-9a0c-45bb-b4b3-676b4af3dc2c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.215726] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.215887] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.215986] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.216180] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.216259] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.216378] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e58c2df-9a0c-45bb-b4b3-676b4af3dc2c',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.373758] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c62ada24-25f1-4b90-b0a4-d9a4254a91e6 in Status: SUCCESS [ 1015.373988] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c62ada24-25f1-4b90-b0a4-d9a4254a91e6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.713182] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 161889a4-32a2-48ee-8fb7-d2a961a4b28d: rpc.has_security_group_logging(os_id): False [ 1015.719015] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.719320] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.719403] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.719624] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.719715] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.719911] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.720020] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.720082] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.720224] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.720354] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.720395] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e58c2df-9a0c-45bb-b4b3-676b4af3dc2c is going to be updated. [ 1015.733069] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.733281] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.733378] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.733715] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.733855] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.734168] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.734403] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.734403] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.734591] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.734702] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.734979] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.735260] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.735373] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.735596] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.735715] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.736022] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.736208] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.736408] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.737657] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.737657] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.737657] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d is going to be updated. [ 1015.752579] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.752579] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.752579] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.752579] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.752579] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.759219] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e58c2df-9a0c-45bb-b4b3-676b4af3dc2c in Status: IN_PROGRESS for 2s [ 1015.808397] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.808689] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.809909] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.810180] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.810409] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.827608] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d in Status: IN_PROGRESS for 2s [ 1017.770880] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e58c2df-9a0c-45bb-b4b3-676b4af3dc2c in Status: SUCCESS [ 1017.771262] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e58c2df-9a0c-45bb-b4b3-676b4af3dc2c deletion is rescheduled due to dependency. [ 1017.771262] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e58c2df-9a0c-45bb-b4b3-676b4af3dc2c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.847135] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d in Status: SUCCESS [ 1017.847385] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.215569] env[65337]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1020.217017] env[65337]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1021.661786] env[65337]: INFO networking_nsxv3.common.synchronization [req-adbf09c2-ad7e-4680-a9fc-484f485b0c75 req-fdac57a6-50ec-44b2-a0cb-428cf3b9d206 tempest-AttachVolumeShelveTestJSON-1101243143 tempest-AttachVolumeShelveTestJSON-1101243143-project-member] Enqueued Resource ID: 7b634dce-1340-436a-a5af-e7d03954de92 with Priority: HIGHEST for action security_group_members [ 1021.662394] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b634dce-1340-436a-a5af-e7d03954de92 with Priority: HIGHEST for action security_group_members [ 1021.662712] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b634dce-1340-436a-a5af-e7d03954de92 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.662858] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b634dce-1340-436a-a5af-e7d03954de92" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.662939] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b634dce-1340-436a-a5af-e7d03954de92" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.663405] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b634dce-1340-436a-a5af-e7d03954de92" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.663524] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.663639] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.663725] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.663832] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.663921] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.664013] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7b634dce-1340-436a-a5af-e7d03954de92',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.119998] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock network-981 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.120326] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "network-981" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.120409] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "network-981" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.120771] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "network-981" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.124009] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.124009] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.124009] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.124009] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.124009] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.124009] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1022.124009] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1022.124009] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1022.124009] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1022.124009] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1022.124009] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1022.124009] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1022.149735] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1022.149919] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1022.150083] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1022.150318] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "network-981" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.150714] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock port-537ead43-a9bc-428f-8a1e-44c7dfff2558 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.150956] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "port-537ead43-a9bc-428f-8a1e-44c7dfff2558" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.151102] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "port-537ead43-a9bc-428f-8a1e-44c7dfff2558" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.152074] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "port-537ead43-a9bc-428f-8a1e-44c7dfff2558" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.152074] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('537ead43-a9bc-428f-8a1e-44c7dfff2558',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.170130] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.170130] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.170130] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.170130] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.170130] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.170130] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.170130] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.170130] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.170553] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.170553] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.170674] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b634dce-1340-436a-a5af-e7d03954de92 already deleted. [ 1022.170730] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b634dce-1340-436a-a5af-e7d03954de92" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.656288] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.656528] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.656677] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.657011] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.657177] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.657334] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Segment Port 537ead43-a9bc-428f-8a1e-44c7dfff2558 not found, creating... [ 1022.657606] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.657832] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.657959] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.658218] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.658377] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.658683] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.658847] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.658974] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.659236] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.659375] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.659517] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Resource: SegmentPort with ID: 537ead43-a9bc-428f-8a1e-44c7dfff2558 is going to be created. [ 1022.680546] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.680955] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.681027] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.681253] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.681483] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.681693] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "port-537ead43-a9bc-428f-8a1e-44c7dfff2558" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.396262] env[65337]: INFO networking_nsxv3.common.synchronization [req-adbf09c2-ad7e-4680-a9fc-484f485b0c75 req-0c9b024d-1373-443c-a724-0e5607cc64fe service nova] Enqueued Resource ID: 7b634dce-1340-436a-a5af-e7d03954de92 with Priority: HIGHEST for action security_group_rules [ 1023.396375] env[65337]: INFO networking_nsxv3.common.synchronization [req-adbf09c2-ad7e-4680-a9fc-484f485b0c75 req-0c9b024d-1373-443c-a724-0e5607cc64fe service nova] Enqueued Resource ID: 7b634dce-1340-436a-a5af-e7d03954de92 with Priority: HIGHEST for action security_group_members [ 1023.396642] env[65337]: INFO networking_nsxv3.common.synchronization [req-adbf09c2-ad7e-4680-a9fc-484f485b0c75 req-0c9b024d-1373-443c-a724-0e5607cc64fe service nova] Enqueued Resource ID: 537ead43-a9bc-428f-8a1e-44c7dfff2558 with Priority: HIGHEST for action port [ 1023.397565] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b634dce-1340-436a-a5af-e7d03954de92 with Priority: HIGHEST for action security_group_rules [ 1023.397701] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b634dce-1340-436a-a5af-e7d03954de92 with Priority: HIGHEST for action security_group_members [ 1023.397799] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 537ead43-a9bc-428f-8a1e-44c7dfff2558 with Priority: HIGHEST for action port [ 1023.398091] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7b634dce-1340-436a-a5af-e7d03954de92 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.398218] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7b634dce-1340-436a-a5af-e7d03954de92" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.398282] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7b634dce-1340-436a-a5af-e7d03954de92" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.398492] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7b634dce-1340-436a-a5af-e7d03954de92" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.398574] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7b634dce-1340-436a-a5af-e7d03954de92',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.399659] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b634dce-1340-436a-a5af-e7d03954de92 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.399659] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b634dce-1340-436a-a5af-e7d03954de92" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.400583] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b634dce-1340-436a-a5af-e7d03954de92" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.400583] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b634dce-1340-436a-a5af-e7d03954de92" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.400583] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.400583] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.400583] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.400583] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.400583] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.400836] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7b634dce-1340-436a-a5af-e7d03954de92',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.402603] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-537ead43-a9bc-428f-8a1e-44c7dfff2558 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.402732] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-537ead43-a9bc-428f-8a1e-44c7dfff2558" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.402784] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-537ead43-a9bc-428f-8a1e-44c7dfff2558" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.403993] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-537ead43-a9bc-428f-8a1e-44c7dfff2558" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.403993] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('537ead43-a9bc-428f-8a1e-44c7dfff2558',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.905526] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7b634dce-1340-436a-a5af-e7d03954de92',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.906963] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b634dce-1340-436a-a5af-e7d03954de92 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.906963] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b634dce-1340-436a-a5af-e7d03954de92" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.907688] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 537ead43-a9bc-428f-8a1e-44c7dfff2558 with status ACTIVE [ 1023.909376] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.909376] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.909376] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.909376] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.909376] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.909376] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.909669] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.909669] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.909744] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.911514] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.911514] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.911514] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.911514] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.911514] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.911514] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.911514] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 537ead43-a9bc-428f-8a1e-44c7dfff2558 is going to be updated. [ 1023.935990] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.936757] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.936757] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.936906] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.937039] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.937166] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-537ead43-a9bc-428f-8a1e-44c7dfff2558" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.070444] env[65337]: INFO networking_nsxv3.common.synchronization [req-efab6bc9-42ab-4139-bea3-2eae21d589d6 req-73823ebf-59be-43a4-85ca-6856bbb03155 tempest-ServersTestJSON-380339010 tempest-ServersTestJSON-380339010-project-member] Enqueued Resource ID: 3d8e0751-3115-433f-8b5b-b20068b58d27 with Priority: HIGHEST for action security_group_members [ 1024.071017] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d8e0751-3115-433f-8b5b-b20068b58d27 with Priority: HIGHEST for action security_group_members [ 1024.071331] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d8e0751-3115-433f-8b5b-b20068b58d27 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.071455] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d8e0751-3115-433f-8b5b-b20068b58d27" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.071522] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d8e0751-3115-433f-8b5b-b20068b58d27" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.071774] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d8e0751-3115-433f-8b5b-b20068b58d27" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.071931] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.072029] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.072094] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.072236] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.072317] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.072408] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3d8e0751-3115-433f-8b5b-b20068b58d27',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.408212] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7b634dce-1340-436a-a5af-e7d03954de92',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.442472] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock network-540 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.442710] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "network-540" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.442848] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "network-540" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.446390] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "network-540" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.446390] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.446390] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.446390] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.446390] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.446390] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.446390] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1024.446390] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1024.446390] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1024.446390] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1024.446390] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1024.446390] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1024.446390] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1024.470734] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1024.471012] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1024.471217] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1024.471771] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "network-540" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.472457] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock port-403e53a2-82a8-433e-aa8f-35740ec68e0c taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.472730] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "port-403e53a2-82a8-433e-aa8f-35740ec68e0c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.472931] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "port-403e53a2-82a8-433e-aa8f-35740ec68e0c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.473422] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "port-403e53a2-82a8-433e-aa8f-35740ec68e0c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.473609] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('403e53a2-82a8-433e-aa8f-35740ec68e0c',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.575236] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.575562] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.575747] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.576101] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.576203] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.576429] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.576576] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.576663] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.576844] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.576939] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.577092] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3d8e0751-3115-433f-8b5b-b20068b58d27 already deleted. [ 1024.577181] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d8e0751-3115-433f-8b5b-b20068b58d27" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.912924] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.913421] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.913421] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.913597] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.913700] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.913986] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b634dce-1340-436a-a5af-e7d03954de92 is going to be created. [ 1024.950200] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.952559] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.952559] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.952559] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.952559] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.967819] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b634dce-1340-436a-a5af-e7d03954de92 in Status: UNINITIALIZED for 2s [ 1024.979231] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.979231] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.979231] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.979231] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.979231] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.982756] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Segment Port 403e53a2-82a8-433e-aa8f-35740ec68e0c not found, creating... [ 1024.982756] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.982756] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.982756] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.982756] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.983223] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.983331] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.983621] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.983760] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.984107] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.984383] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.984963] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Resource: SegmentPort with ID: 403e53a2-82a8-433e-aa8f-35740ec68e0c is going to be created. [ 1025.008671] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.009017] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.009219] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.009560] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.009847] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.010457] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "port-403e53a2-82a8-433e-aa8f-35740ec68e0c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.208212] env[65337]: INFO networking_nsxv3.common.synchronization [req-dadf0186-af03-4178-9efd-6a989d0ab416 req-2955f7cc-1a7b-465e-a6b1-d97323d36953 tempest-DeleteServersTestJSON-1654690426 tempest-DeleteServersTestJSON-1654690426-project-member] Enqueued Resource ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d with Priority: HIGHEST for action security_group_members [ 1025.208736] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d with Priority: HIGHEST for action security_group_members [ 1025.209050] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-161889a4-32a2-48ee-8fb7-d2a961a4b28d taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.209186] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.209268] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.209434] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.209759] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.209871] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.209930] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.210114] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.210199] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.210294] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('161889a4-32a2-48ee-8fb7-d2a961a4b28d',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.712534] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.712644] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.712975] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.713091] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.713497] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.713497] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.713675] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.713675] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.713784] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.713864] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.713953] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d is going to be updated. [ 1025.752788] env[65337]: INFO networking_nsxv3.common.synchronization [req-efab6bc9-42ab-4139-bea3-2eae21d589d6 req-bcc29dcf-a759-40c5-9ffa-f83d227c122e service nova] Enqueued Resource ID: 3d8e0751-3115-433f-8b5b-b20068b58d27 with Priority: HIGHEST for action security_group_rules [ 1025.753203] env[65337]: INFO networking_nsxv3.common.synchronization [req-efab6bc9-42ab-4139-bea3-2eae21d589d6 req-bcc29dcf-a759-40c5-9ffa-f83d227c122e service nova] Enqueued Resource ID: 3d8e0751-3115-433f-8b5b-b20068b58d27 with Priority: HIGHEST for action security_group_members [ 1025.753488] env[65337]: INFO networking_nsxv3.common.synchronization [req-efab6bc9-42ab-4139-bea3-2eae21d589d6 req-bcc29dcf-a759-40c5-9ffa-f83d227c122e service nova] Enqueued Resource ID: 403e53a2-82a8-433e-aa8f-35740ec68e0c with Priority: HIGHEST for action port [ 1025.754949] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.755173] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.755297] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.755615] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.755822] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.761497] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d8e0751-3115-433f-8b5b-b20068b58d27 with Priority: HIGHEST for action security_group_rules [ 1025.761755] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d8e0751-3115-433f-8b5b-b20068b58d27 with Priority: HIGHEST for action security_group_members [ 1025.761896] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 403e53a2-82a8-433e-aa8f-35740ec68e0c with Priority: HIGHEST for action port [ 1025.762303] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3d8e0751-3115-433f-8b5b-b20068b58d27 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.762738] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3d8e0751-3115-433f-8b5b-b20068b58d27" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.762838] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3d8e0751-3115-433f-8b5b-b20068b58d27" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.763097] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3d8e0751-3115-433f-8b5b-b20068b58d27" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.763228] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3d8e0751-3115-433f-8b5b-b20068b58d27',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.764846] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d8e0751-3115-433f-8b5b-b20068b58d27 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.765094] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d8e0751-3115-433f-8b5b-b20068b58d27" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.765137] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d8e0751-3115-433f-8b5b-b20068b58d27" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.765327] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d8e0751-3115-433f-8b5b-b20068b58d27" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.765627] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.765696] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.765744] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.765885] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.765972] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.766089] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3d8e0751-3115-433f-8b5b-b20068b58d27',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.767361] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-403e53a2-82a8-433e-aa8f-35740ec68e0c taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.767678] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-403e53a2-82a8-433e-aa8f-35740ec68e0c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.767797] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-403e53a2-82a8-433e-aa8f-35740ec68e0c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.767977] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-403e53a2-82a8-433e-aa8f-35740ec68e0c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.768155] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('403e53a2-82a8-433e-aa8f-35740ec68e0c',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.780313] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d in Status: IN_PROGRESS for 2s [ 1026.272485] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 403e53a2-82a8-433e-aa8f-35740ec68e0c with status ACTIVE [ 1026.272829] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.273028] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.273124] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.273402] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.273526] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.273773] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.273911] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.273997] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.274227] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.274324] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.274581] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.274715] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.274801] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.274987] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.275115] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.275231] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 403e53a2-82a8-433e-aa8f-35740ec68e0c is going to be updated. [ 1026.276837] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d8e0751-3115-433f-8b5b-b20068b58d27 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.277053] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d8e0751-3115-433f-8b5b-b20068b58d27" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.277182] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3d8e0751-3115-433f-8b5b-b20068b58d27',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.327431] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.327632] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.327730] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.327977] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.328157] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.328352] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-403e53a2-82a8-433e-aa8f-35740ec68e0c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.780880] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3d8e0751-3115-433f-8b5b-b20068b58d27',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.979183] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b634dce-1340-436a-a5af-e7d03954de92 in Status: SUCCESS [ 1026.979416] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b634dce-1340-436a-a5af-e7d03954de92" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.979568] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b634dce-1340-436a-a5af-e7d03954de92" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.979798] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b634dce-1340-436a-a5af-e7d03954de92" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.980048] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.980156] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.980291] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.980385] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.980434] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.980529] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b634dce-1340-436a-a5af-e7d03954de92" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.980622] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7b634dce-1340-436a-a5af-e7d03954de92',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.284066] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.284066] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.284066] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.284600] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.284600] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.284600] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3d8e0751-3115-433f-8b5b-b20068b58d27 is going to be created. [ 1027.323469] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.323700] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.323807] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.324134] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.324436] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.339086] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d8e0751-3115-433f-8b5b-b20068b58d27 in Status: UNINITIALIZED for 2s [ 1027.483864] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7b634dce-1340-436a-a5af-e7d03954de92',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.789853] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d in Status: SUCCESS [ 1027.790109] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d deletion is rescheduled due to dependency. [ 1027.790237] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.986365] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7b634dce-1340-436a-a5af-e7d03954de92: rpc.has_security_group_logging(os_id): False [ 1028.007139] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.007302] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.007372] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.007577] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.007670] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.007910] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.008014] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.008080] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.008226] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.008302] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.008385] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7b634dce-1340-436a-a5af-e7d03954de92 is going to be created. [ 1028.078403] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.078559] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.078627] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.078946] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.079097] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.091422] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7b634dce-1340-436a-a5af-e7d03954de92 in Status: IN_PROGRESS for 2s [ 1028.447236] env[65337]: INFO networking_nsxv3.common.synchronization [req-27844224-1c3e-47d9-888d-b3a52c868549 req-804185bf-ce19-4a54-bd53-084924fc0183 tempest-AttachInterfacesTestJSON-1783062477 tempest-AttachInterfacesTestJSON-1783062477-project-member] Enqueued Resource ID: c62ada24-25f1-4b90-b0a4-d9a4254a91e6 with Priority: HIGHEST for action security_group_members [ 1028.447648] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c62ada24-25f1-4b90-b0a4-d9a4254a91e6 with Priority: HIGHEST for action security_group_members [ 1028.447955] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-c62ada24-25f1-4b90-b0a4-d9a4254a91e6 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.448172] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c62ada24-25f1-4b90-b0a4-d9a4254a91e6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.448255] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c62ada24-25f1-4b90-b0a4-d9a4254a91e6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.448432] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c62ada24-25f1-4b90-b0a4-d9a4254a91e6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.448692] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.448692] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.448824] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.449588] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.449714] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.449806] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c62ada24-25f1-4b90-b0a4-d9a4254a91e6',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.802613] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock network-250 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.802812] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "network-250" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.802951] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "network-250" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.803239] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "network-250" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.803529] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.803688] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.803803] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.804016] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.804165] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.804374] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1028.804490] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1028.804610] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1028.804735] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1028.804848] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1028.804951] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1028.805091] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1028.826810] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1028.827068] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1028.827176] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1028.827277] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "network-250" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.827602] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock port-c3f462e8-ff26-4430-87c9-ddb35ddad84b taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.827797] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "port-c3f462e8-ff26-4430-87c9-ddb35ddad84b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.827918] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "port-c3f462e8-ff26-4430-87c9-ddb35ddad84b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.828270] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "port-c3f462e8-ff26-4430-87c9-ddb35ddad84b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.828410] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c3f462e8-ff26-4430-87c9-ddb35ddad84b',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.952339] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c62ada24-25f1-4b90-b0a4-d9a4254a91e6',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.331488] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.331728] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.331854] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.332151] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.332296] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.332447] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Segment Port c3f462e8-ff26-4430-87c9-ddb35ddad84b not found, creating... [ 1029.332959] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.333228] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.333383] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.333712] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.333872] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.334209] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.334412] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.334543] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.334777] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.334912] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.335133] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Resource: SegmentPort with ID: c3f462e8-ff26-4430-87c9-ddb35ddad84b is going to be created. [ 1029.349743] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d8e0751-3115-433f-8b5b-b20068b58d27 in Status: SUCCESS [ 1029.350011] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d8e0751-3115-433f-8b5b-b20068b58d27" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.350203] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d8e0751-3115-433f-8b5b-b20068b58d27" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.350446] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d8e0751-3115-433f-8b5b-b20068b58d27" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.350638] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.350776] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.350842] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.351021] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.351099] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.351196] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d8e0751-3115-433f-8b5b-b20068b58d27" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.351286] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3d8e0751-3115-433f-8b5b-b20068b58d27',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.356763] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.356978] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.357228] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.357519] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.357761] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.357989] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "port-c3f462e8-ff26-4430-87c9-ddb35ddad84b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.455367] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c62ada24-25f1-4b90-b0a4-d9a4254a91e6',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.854470] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3d8e0751-3115-433f-8b5b-b20068b58d27',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.958530] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.959854] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.959971] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.960251] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.960347] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.960458] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c62ada24-25f1-4b90-b0a4-d9a4254a91e6 is going to be updated. [ 1029.988565] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.988986] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.989086] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.989356] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.989539] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.999396] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c62ada24-25f1-4b90-b0a4-d9a4254a91e6 in Status: IN_PROGRESS for 2s [ 1030.106649] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7b634dce-1340-436a-a5af-e7d03954de92 in Status: SUCCESS [ 1030.106867] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7b634dce-1340-436a-a5af-e7d03954de92" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.125919] env[65337]: INFO networking_nsxv3.common.synchronization [req-27844224-1c3e-47d9-888d-b3a52c868549 req-c09bc922-5e36-4222-9c54-6e8917ccdeb9 service nova] Enqueued Resource ID: c62ada24-25f1-4b90-b0a4-d9a4254a91e6 with Priority: HIGHEST for action security_group_rules [ 1030.126110] env[65337]: INFO networking_nsxv3.common.synchronization [req-27844224-1c3e-47d9-888d-b3a52c868549 req-c09bc922-5e36-4222-9c54-6e8917ccdeb9 service nova] Enqueued Resource ID: c62ada24-25f1-4b90-b0a4-d9a4254a91e6 with Priority: HIGHEST for action security_group_members [ 1030.126249] env[65337]: INFO networking_nsxv3.common.synchronization [req-27844224-1c3e-47d9-888d-b3a52c868549 req-c09bc922-5e36-4222-9c54-6e8917ccdeb9 service nova] Enqueued Resource ID: c3f462e8-ff26-4430-87c9-ddb35ddad84b with Priority: HIGHEST for action port [ 1030.126863] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c62ada24-25f1-4b90-b0a4-d9a4254a91e6 with Priority: HIGHEST for action security_group_rules [ 1030.126993] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c62ada24-25f1-4b90-b0a4-d9a4254a91e6 with Priority: HIGHEST for action security_group_members [ 1030.127143] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3f462e8-ff26-4430-87c9-ddb35ddad84b with Priority: HIGHEST for action port [ 1030.127677] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c62ada24-25f1-4b90-b0a4-d9a4254a91e6 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.127872] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c62ada24-25f1-4b90-b0a4-d9a4254a91e6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.127872] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c62ada24-25f1-4b90-b0a4-d9a4254a91e6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.128124] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c62ada24-25f1-4b90-b0a4-d9a4254a91e6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.129456] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c62ada24-25f1-4b90-b0a4-d9a4254a91e6',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.133222] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-c62ada24-25f1-4b90-b0a4-d9a4254a91e6 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.133338] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c62ada24-25f1-4b90-b0a4-d9a4254a91e6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.133527] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-c3f462e8-ff26-4430-87c9-ddb35ddad84b taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.133644] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c3f462e8-ff26-4430-87c9-ddb35ddad84b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.133692] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c3f462e8-ff26-4430-87c9-ddb35ddad84b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.133872] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c3f462e8-ff26-4430-87c9-ddb35ddad84b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.133948] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c3f462e8-ff26-4430-87c9-ddb35ddad84b',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.358066] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3d8e0751-3115-433f-8b5b-b20068b58d27: rpc.has_security_group_logging(os_id): False [ 1030.379350] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.380175] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.380175] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.380175] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.380175] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.380401] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.381049] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.381049] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.381049] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.381049] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.381049] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3d8e0751-3115-433f-8b5b-b20068b58d27 is going to be created. [ 1030.448464] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.448629] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.448696] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.449008] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.449213] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.461288] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3d8e0751-3115-433f-8b5b-b20068b58d27 in Status: IN_PROGRESS for 2s [ 1030.637075] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-c62ada24-25f1-4b90-b0a4-d9a4254a91e6 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.637454] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c62ada24-25f1-4b90-b0a4-d9a4254a91e6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.637538] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c3f462e8-ff26-4430-87c9-ddb35ddad84b with status ACTIVE [ 1030.637859] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.638048] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.638162] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.638859] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.639010] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.639266] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.639420] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.639709] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.639815] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.639936] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.640551] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.640726] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.640920] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.641129] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.641286] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.642111] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c3f462e8-ff26-4430-87c9-ddb35ddad84b is going to be updated. [ 1030.672535] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.672535] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.672535] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.672535] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.672535] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.672806] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c3f462e8-ff26-4430-87c9-ddb35ddad84b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.012597] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c62ada24-25f1-4b90-b0a4-d9a4254a91e6 in Status: SUCCESS [ 1032.013033] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c62ada24-25f1-4b90-b0a4-d9a4254a91e6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.013033] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c62ada24-25f1-4b90-b0a4-d9a4254a91e6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.013226] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c62ada24-25f1-4b90-b0a4-d9a4254a91e6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.013422] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.013594] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.013680] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.013776] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.013856] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.013953] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c62ada24-25f1-4b90-b0a4-d9a4254a91e6',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.475738] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3d8e0751-3115-433f-8b5b-b20068b58d27 in Status: SUCCESS [ 1032.475968] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3d8e0751-3115-433f-8b5b-b20068b58d27" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.517629] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c62ada24-25f1-4b90-b0a4-d9a4254a91e6',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.020048] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c62ada24-25f1-4b90-b0a4-d9a4254a91e6',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.522615] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.522781] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.522850] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.523169] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.523276] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.523408] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c62ada24-25f1-4b90-b0a4-d9a4254a91e6 is going to be updated. [ 1033.551987] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.552265] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.552265] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.552412] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.552583] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.562017] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c62ada24-25f1-4b90-b0a4-d9a4254a91e6 in Status: IN_PROGRESS for 2s [ 1035.127782] env[65337]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1035.128315] env[65337]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1035.573337] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c62ada24-25f1-4b90-b0a4-d9a4254a91e6 in Status: SUCCESS [ 1035.573584] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c62ada24-25f1-4b90-b0a4-d9a4254a91e6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.573849] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c62ada24-25f1-4b90-b0a4-d9a4254a91e6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.574172] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c62ada24-25f1-4b90-b0a4-d9a4254a91e6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.574251] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.574372] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.574407] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.574623] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.574728] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.574836] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c62ada24-25f1-4b90-b0a4-d9a4254a91e6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.574962] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c62ada24-25f1-4b90-b0a4-d9a4254a91e6',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.077121] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c62ada24-25f1-4b90-b0a4-d9a4254a91e6',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.580057] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c62ada24-25f1-4b90-b0a4-d9a4254a91e6: rpc.has_security_group_logging(os_id): False [ 1036.597910] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.598142] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.598142] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.598356] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.598443] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.599016] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.599016] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.599016] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.599016] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.599269] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.599269] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c62ada24-25f1-4b90-b0a4-d9a4254a91e6 is going to be updated. [ 1036.683142] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.683441] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.683441] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.683757] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.683936] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.728632] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c62ada24-25f1-4b90-b0a4-d9a4254a91e6 in Status: IN_PROGRESS for 2s [ 1038.743808] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c62ada24-25f1-4b90-b0a4-d9a4254a91e6 in Status: SUCCESS [ 1038.744233] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c62ada24-25f1-4b90-b0a4-d9a4254a91e6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.600548] env[65337]: INFO networking_nsxv3.common.synchronization [None req-44f3839b-af4c-41f6-91d8-39fe49ad28a5 tempest-AttachInterfacesTestJSON-1783062477 tempest-AttachInterfacesTestJSON-1783062477-project-member] Enqueued Resource ID: 94a13e53-dcf7-4643-ade4-8789dc9eabc4 with Priority: HIGHEST for action security_group_members [ 1039.600548] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94a13e53-dcf7-4643-ade4-8789dc9eabc4 with Priority: HIGHEST for action security_group_members [ 1039.601313] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-94a13e53-dcf7-4643-ade4-8789dc9eabc4 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.601445] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.601490] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.601676] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.601843] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.602248] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.602248] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.602248] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.602379] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.602379] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('94a13e53-dcf7-4643-ade4-8789dc9eabc4',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.104461] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.104785] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.104785] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.104995] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.104995] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.105195] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.105295] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.105355] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.105506] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.105604] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.105691] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 94a13e53-dcf7-4643-ade4-8789dc9eabc4 is going to be updated. [ 1040.134550] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.134698] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.134768] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.134972] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.135126] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.145191] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94a13e53-dcf7-4643-ade4-8789dc9eabc4 in Status: IN_PROGRESS for 2s [ 1041.575857] env[65337]: INFO networking_nsxv3.common.synchronization [req-510cccc5-5400-46ca-b1a5-b27f6039b1e7 req-71ab62f5-c8d9-41bc-99f2-0c3a44b9b509 tempest-ServersTestJSON-1910122825 tempest-ServersTestJSON-1910122825-project-member] Enqueued Resource ID: af1da677-d95a-4cec-95fa-b9208101b7dd with Priority: HIGHEST for action security_group_members [ 1041.576440] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af1da677-d95a-4cec-95fa-b9208101b7dd with Priority: HIGHEST for action security_group_members [ 1041.576760] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-af1da677-d95a-4cec-95fa-b9208101b7dd taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.576884] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.576948] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.577162] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.577315] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.577414] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.577538] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.577698] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.577782] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.578314] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('af1da677-d95a-4cec-95fa-b9208101b7dd',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.893015] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock network-48 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.893313] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "network-48" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.893313] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "network-48" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.894189] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "network-48" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.894189] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.894505] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.894505] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.894943] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.894943] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.894943] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1041.895244] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1041.895244] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1041.895461] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1041.895461] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1041.895461] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1041.895748] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1041.922517] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1041.922761] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1041.922929] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1041.923154] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "network-48" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.923751] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock port-a3179bbe-9370-443b-b296-872a686c2a97 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.923966] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "port-a3179bbe-9370-443b-b296-872a686c2a97" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.924135] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "port-a3179bbe-9370-443b-b296-872a686c2a97" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.924837] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "port-a3179bbe-9370-443b-b296-872a686c2a97" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.925048] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a3179bbe-9370-443b-b296-872a686c2a97',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.081644] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('af1da677-d95a-4cec-95fa-b9208101b7dd',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.154863] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94a13e53-dcf7-4643-ade4-8789dc9eabc4 in Status: SUCCESS [ 1042.155075] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 94a13e53-dcf7-4643-ade4-8789dc9eabc4 deletion is rescheduled due to dependency. [ 1042.155175] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.427378] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.427617] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.427745] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.428040] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.428195] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.428345] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Segment Port a3179bbe-9370-443b-b296-872a686c2a97 not found, creating... [ 1042.428607] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.428765] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.428954] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.429141] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.429253] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.429527] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.429682] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.429798] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.430011] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.430149] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.430284] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Resource: SegmentPort with ID: a3179bbe-9370-443b-b296-872a686c2a97 is going to be created. [ 1042.451748] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.452010] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.452105] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.452369] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.452953] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.452953] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "port-a3179bbe-9370-443b-b296-872a686c2a97" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.583778] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('af1da677-d95a-4cec-95fa-b9208101b7dd',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.086844] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.086844] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.086844] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.087072] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.087156] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.087256] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: af1da677-d95a-4cec-95fa-b9208101b7dd is going to be updated. [ 1043.117583] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.117827] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.117939] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.118274] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.118506] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.129150] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af1da677-d95a-4cec-95fa-b9208101b7dd in Status: IN_PROGRESS for 2s [ 1043.154029] env[65337]: INFO networking_nsxv3.common.synchronization [req-510cccc5-5400-46ca-b1a5-b27f6039b1e7 req-bd4d86fa-a936-43a8-b755-5ff9000d833f service nova] Enqueued Resource ID: af1da677-d95a-4cec-95fa-b9208101b7dd with Priority: HIGHEST for action security_group_rules [ 1043.154146] env[65337]: INFO networking_nsxv3.common.synchronization [req-510cccc5-5400-46ca-b1a5-b27f6039b1e7 req-bd4d86fa-a936-43a8-b755-5ff9000d833f service nova] Enqueued Resource ID: af1da677-d95a-4cec-95fa-b9208101b7dd with Priority: HIGHEST for action security_group_members [ 1043.154233] env[65337]: INFO networking_nsxv3.common.synchronization [req-510cccc5-5400-46ca-b1a5-b27f6039b1e7 req-bd4d86fa-a936-43a8-b755-5ff9000d833f service nova] Enqueued Resource ID: a3179bbe-9370-443b-b296-872a686c2a97 with Priority: HIGHEST for action port [ 1043.154761] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af1da677-d95a-4cec-95fa-b9208101b7dd with Priority: HIGHEST for action security_group_rules [ 1043.154876] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af1da677-d95a-4cec-95fa-b9208101b7dd with Priority: HIGHEST for action security_group_members [ 1043.154978] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3179bbe-9370-443b-b296-872a686c2a97 with Priority: HIGHEST for action port [ 1043.155261] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-af1da677-d95a-4cec-95fa-b9208101b7dd taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.155384] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.155452] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.155740] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.155740] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('af1da677-d95a-4cec-95fa-b9208101b7dd',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.156620] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-af1da677-d95a-4cec-95fa-b9208101b7dd taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.156770] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.156961] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-a3179bbe-9370-443b-b296-872a686c2a97 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.157099] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a3179bbe-9370-443b-b296-872a686c2a97" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.157161] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a3179bbe-9370-443b-b296-872a686c2a97" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.157337] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a3179bbe-9370-443b-b296-872a686c2a97" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.157422] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a3179bbe-9370-443b-b296-872a686c2a97',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.658991] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-af1da677-d95a-4cec-95fa-b9208101b7dd taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.659404] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.659404] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a3179bbe-9370-443b-b296-872a686c2a97 with status ACTIVE [ 1043.659596] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.659679] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.659737] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.659985] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.660183] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.660340] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.660466] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.660541] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.660711] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.660810] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.661026] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.661173] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.661251] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.661404] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.661509] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.661608] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a3179bbe-9370-443b-b296-872a686c2a97 is going to be updated. [ 1043.685232] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.685232] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.685232] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.685232] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.685232] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.685232] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a3179bbe-9370-443b-b296-872a686c2a97" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.139631] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af1da677-d95a-4cec-95fa-b9208101b7dd in Status: SUCCESS [ 1045.140031] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.140099] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.140307] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.140519] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.140654] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.140700] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.140838] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.140918] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.141038] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('af1da677-d95a-4cec-95fa-b9208101b7dd',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.643903] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('af1da677-d95a-4cec-95fa-b9208101b7dd',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.147347] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('af1da677-d95a-4cec-95fa-b9208101b7dd',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.650096] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.650239] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.650288] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.650543] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.650636] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.650737] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: af1da677-d95a-4cec-95fa-b9208101b7dd is going to be updated. [ 1046.690094] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.690319] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.690319] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.690532] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.690682] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.699928] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af1da677-d95a-4cec-95fa-b9208101b7dd in Status: IN_PROGRESS for 2s [ 1047.031773] env[65337]: INFO networking_nsxv3.common.synchronization [req-8f4f61bb-ff89-4ad3-957d-fc9e049ecec8 req-51cfd19b-a0ea-499c-a96c-1c0915383cd3 tempest-ServerDiskConfigTestJSON-1745593668 tempest-ServerDiskConfigTestJSON-1745593668-project-member] Enqueued Resource ID: 653446ea-2b31-43b8-a920-884274265c75 with Priority: HIGHEST for action security_group_members [ 1047.031916] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 653446ea-2b31-43b8-a920-884274265c75 with Priority: HIGHEST for action security_group_members [ 1047.032220] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-653446ea-2b31-43b8-a920-884274265c75 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.032342] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.032409] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.032601] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.032764] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.033142] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.033142] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.033142] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.033142] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.033410] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('653446ea-2b31-43b8-a920-884274265c75',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.385111] env[65337]: INFO networking_nsxv3.common.synchronization [req-8936868a-1aee-46aa-8fca-f699780723e1 req-d4a706c7-3029-4674-adc6-1821c133b377 tempest-DeleteServersTestJSON-1654690426 tempest-DeleteServersTestJSON-1654690426-project-member] Enqueued Resource ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d with Priority: HIGHEST for action security_group_members [ 1047.385952] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d with Priority: HIGHEST for action security_group_members [ 1047.386340] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-161889a4-32a2-48ee-8fb7-d2a961a4b28d taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.386485] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.386634] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.387792] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.387792] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.387792] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.387792] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.387792] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.387792] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.387792] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('161889a4-32a2-48ee-8fb7-d2a961a4b28d',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.536503] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.536710] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.536787] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.537171] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.537171] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.537366] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.537512] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.537604] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.537750] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.537861] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.538037] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 653446ea-2b31-43b8-a920-884274265c75 is going to be updated. [ 1047.568021] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.568216] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.568269] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.568450] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.568589] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.578360] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 653446ea-2b31-43b8-a920-884274265c75 in Status: IN_PROGRESS for 2s [ 1047.702209] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock network-211 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.702209] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "network-211" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.702209] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "network-211" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.702571] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "network-211" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.702844] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.703056] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.703184] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.703427] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.703664] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.703906] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1047.704118] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1047.704317] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1047.704483] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1047.704679] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1047.704831] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1047.704992] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1047.726450] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1047.726663] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1047.726885] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1047.727169] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "network-211" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.727611] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock port-23a7c411-fe4e-46ad-ac1a-43c58e8bb13a taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.727866] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "port-23a7c411-fe4e-46ad-ac1a-43c58e8bb13a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.728082] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "port-23a7c411-fe4e-46ad-ac1a-43c58e8bb13a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.728515] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "port-23a7c411-fe4e-46ad-ac1a-43c58e8bb13a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.728722] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('23a7c411-fe4e-46ad-ac1a-43c58e8bb13a',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.891194] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.891332] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.891376] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.891581] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.891677] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.891878] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.891980] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.892046] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.892204] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.892283] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.892381] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d is going to be updated. [ 1047.920698] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.920886] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.920932] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.921134] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.921274] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.931929] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d in Status: IN_PROGRESS for 2s [ 1048.231702] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.232031] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.232155] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.232438] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.232586] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.232756] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Segment Port 23a7c411-fe4e-46ad-ac1a-43c58e8bb13a not found, creating... [ 1048.233075] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.233257] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.233374] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.233618] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.233773] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.234067] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.234225] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.234338] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.234568] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.234699] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.234865] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Resource: SegmentPort with ID: 23a7c411-fe4e-46ad-ac1a-43c58e8bb13a is going to be created. [ 1048.260524] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.260854] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.261072] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.261598] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.262014] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.263336] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "port-23a7c411-fe4e-46ad-ac1a-43c58e8bb13a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.710288] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af1da677-d95a-4cec-95fa-b9208101b7dd in Status: SUCCESS [ 1048.710610] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.710731] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.710950] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.711155] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.711272] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.711350] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.711477] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.711554] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.711638] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.711727] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('af1da677-d95a-4cec-95fa-b9208101b7dd',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.217266] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-af1da677-d95a-4cec-95fa-b9208101b7dd taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.217587] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.217725] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.218062] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.218322] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.218461] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.218552] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.218757] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.218899] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.219026] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.219188] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-af1da677-d95a-4cec-95fa-b9208101b7dd taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.219282] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.219366] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.219518] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.219678] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.219786] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.219848] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.220040] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.220144] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.220240] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.220347] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('af1da677-d95a-4cec-95fa-b9208101b7dd',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.407308] env[65337]: INFO networking_nsxv3.common.synchronization [req-8936868a-1aee-46aa-8fca-f699780723e1 req-2a5ef533-962b-4821-8864-d24f95cd05d7 service nova] Enqueued Resource ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d with Priority: HIGHEST for action security_group_rules [ 1049.407518] env[65337]: INFO networking_nsxv3.common.synchronization [req-8936868a-1aee-46aa-8fca-f699780723e1 req-2a5ef533-962b-4821-8864-d24f95cd05d7 service nova] Enqueued Resource ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d with Priority: HIGHEST for action security_group_members [ 1049.407660] env[65337]: INFO networking_nsxv3.common.synchronization [req-8936868a-1aee-46aa-8fca-f699780723e1 req-2a5ef533-962b-4821-8864-d24f95cd05d7 service nova] Enqueued Resource ID: 23a7c411-fe4e-46ad-ac1a-43c58e8bb13a with Priority: HIGHEST for action port [ 1049.408192] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d with Priority: HIGHEST for action security_group_rules [ 1049.408313] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d with Priority: HIGHEST for action security_group_members [ 1049.408427] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23a7c411-fe4e-46ad-ac1a-43c58e8bb13a with Priority: HIGHEST for action port [ 1049.408828] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-161889a4-32a2-48ee-8fb7-d2a961a4b28d taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.408977] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.409082] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.409294] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.409385] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('161889a4-32a2-48ee-8fb7-d2a961a4b28d',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.410299] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-161889a4-32a2-48ee-8fb7-d2a961a4b28d taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.411623] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.411623] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-23a7c411-fe4e-46ad-ac1a-43c58e8bb13a taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.411623] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-23a7c411-fe4e-46ad-ac1a-43c58e8bb13a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.411623] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-23a7c411-fe4e-46ad-ac1a-43c58e8bb13a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.411623] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-23a7c411-fe4e-46ad-ac1a-43c58e8bb13a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.411623] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('23a7c411-fe4e-46ad-ac1a-43c58e8bb13a',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.589526] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 653446ea-2b31-43b8-a920-884274265c75 in Status: SUCCESS [ 1049.589765] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 653446ea-2b31-43b8-a920-884274265c75 deletion is rescheduled due to dependency. [ 1049.590371] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.723626] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for af1da677-d95a-4cec-95fa-b9208101b7dd: rpc.has_security_group_logging(os_id): False [ 1049.740902] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.741152] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.741250] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.741456] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.741574] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.741859] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.741969] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.742066] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.742271] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.742380] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.742605] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.742725] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.742800] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.743051] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.743139] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.743377] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.743529] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.743633] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.743822] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.743922] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.744060] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: af1da677-d95a-4cec-95fa-b9208101b7dd is going to be updated. [ 1049.807241] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.807409] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.807471] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.807682] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.807829] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.820150] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: af1da677-d95a-4cec-95fa-b9208101b7dd in Status: IN_PROGRESS for 2s [ 1049.913169] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-161889a4-32a2-48ee-8fb7-d2a961a4b28d taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.913900] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.914689] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 23a7c411-fe4e-46ad-ac1a-43c58e8bb13a with status ACTIVE [ 1049.914870] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.915047] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.915162] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.915361] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.915489] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.915700] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.915848] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.915950] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.916107] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.916240] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.916364] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.916472] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.916543] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.916700] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.916767] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.916906] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 23a7c411-fe4e-46ad-ac1a-43c58e8bb13a is going to be updated. [ 1049.949590] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d in Status: SUCCESS [ 1049.949817] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d deletion is rescheduled due to dependency. [ 1049.949901] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.950104] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.950287] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.950472] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.950601] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.950704] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.950793] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.951507] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.951507] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('161889a4-32a2-48ee-8fb7-d2a961a4b28d',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.964792] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.964994] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.964994] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.965256] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.965379] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.965614] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-23a7c411-fe4e-46ad-ac1a-43c58e8bb13a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.453791] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('161889a4-32a2-48ee-8fb7-d2a961a4b28d',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.956460] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('161889a4-32a2-48ee-8fb7-d2a961a4b28d',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.459454] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.459665] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.459729] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.459992] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.460140] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.460291] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d is going to be updated. [ 1051.498030] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.498230] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.498390] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.498447] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.498594] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.512181] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d in Status: IN_PROGRESS for 2s [ 1051.591376] env[65337]: INFO networking_nsxv3.common.synchronization [req-2fdea5e5-12b3-45d4-8ea4-66d43b389480 req-543d5c77-c7a0-412c-9cd5-bcd3768a75f1 tempest-ServerDiskConfigTestJSON-1745593668 tempest-ServerDiskConfigTestJSON-1745593668-project-member] Enqueued Resource ID: 653446ea-2b31-43b8-a920-884274265c75 with Priority: HIGHEST for action security_group_members [ 1051.592174] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 653446ea-2b31-43b8-a920-884274265c75 with Priority: HIGHEST for action security_group_members [ 1051.592498] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-653446ea-2b31-43b8-a920-884274265c75 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.592598] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.592669] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.592862] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.593033] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.593154] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.593248] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.593526] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.593702] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.593827] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('653446ea-2b31-43b8-a920-884274265c75',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.835710] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: af1da677-d95a-4cec-95fa-b9208101b7dd in Status: SUCCESS [ 1051.835916] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.912200] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock network-250 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.912410] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "network-250" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.912539] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "network-250" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.912815] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "network-250" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.913079] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.913430] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.913430] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.913614] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.913790] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.914064] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1051.914224] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1051.914371] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1051.914516] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1051.914663] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1051.914808] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1051.914981] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1051.919050] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock network-73 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.919221] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "network-73" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.919801] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "network-73" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.919801] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "network-73" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.920169] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.920534] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.920666] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.920995] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.921274] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.921716] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1051.921872] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1051.922117] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1051.922347] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1051.922505] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1051.922714] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1051.922955] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1051.945939] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1051.945939] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1051.946293] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1051.946293] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "network-250" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.946694] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock port-71070c08-123d-4587-ad53-5a8cecb1bb3d taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.946856] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "port-71070c08-123d-4587-ad53-5a8cecb1bb3d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.946995] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "port-71070c08-123d-4587-ad53-5a8cecb1bb3d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.947365] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "port-71070c08-123d-4587-ad53-5a8cecb1bb3d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.947535] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('71070c08-123d-4587-ad53-5a8cecb1bb3d',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.959070] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1051.959470] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Cache value generated in 0.036 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1051.959470] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1051.959676] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "network-73" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.960157] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock port-6f0b91e6-a13c-446b-ae15-f44016787f03 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.960342] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "port-6f0b91e6-a13c-446b-ae15-f44016787f03" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.960473] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "port-6f0b91e6-a13c-446b-ae15-f44016787f03" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.961106] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "port-6f0b91e6-a13c-446b-ae15-f44016787f03" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.961344] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6f0b91e6-a13c-446b-ae15-f44016787f03',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.096817] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.097080] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.097080] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.097308] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.097443] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.097650] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.097756] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.097826] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.098010] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.098115] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.098207] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 653446ea-2b31-43b8-a920-884274265c75 is going to be updated. [ 1052.125539] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.125847] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.125847] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.126071] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.126212] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.137571] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 653446ea-2b31-43b8-a920-884274265c75 in Status: IN_PROGRESS for 2s [ 1052.450465] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.450741] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.450900] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.451235] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.451410] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.451598] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Segment Port 71070c08-123d-4587-ad53-5a8cecb1bb3d not found, creating... [ 1052.451999] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.452216] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.452349] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.452616] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.452792] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.453137] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.453322] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.453533] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.453807] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.453964] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.454155] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Resource: SegmentPort with ID: 71070c08-123d-4587-ad53-5a8cecb1bb3d is going to be created. [ 1052.464431] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.464691] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.464846] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.465176] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.465343] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.465551] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Segment Port 6f0b91e6-a13c-446b-ae15-f44016787f03 not found, creating... [ 1052.465861] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.466066] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.466211] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.466475] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.466649] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.467010] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.467217] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.467348] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.467594] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.467731] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.467869] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Resource: SegmentPort with ID: 6f0b91e6-a13c-446b-ae15-f44016787f03 is going to be created. [ 1052.482658] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.483042] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.483243] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.483662] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.483997] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.484354] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "port-71070c08-123d-4587-ad53-5a8cecb1bb3d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.494777] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.495192] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.495395] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.495773] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.496273] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.496475] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "port-6f0b91e6-a13c-446b-ae15-f44016787f03" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.200773] env[65337]: INFO networking_nsxv3.common.synchronization [req-daed0a1a-ece2-4b09-8609-b1ec30453345 req-21617112-7f17-4493-954b-b4bc3fe2586f service nova] Enqueued Resource ID: 94a13e53-dcf7-4643-ade4-8789dc9eabc4 with Priority: HIGHEST for action security_group_rules [ 1053.200773] env[65337]: INFO networking_nsxv3.common.synchronization [req-daed0a1a-ece2-4b09-8609-b1ec30453345 req-21617112-7f17-4493-954b-b4bc3fe2586f service nova] Enqueued Resource ID: 94a13e53-dcf7-4643-ade4-8789dc9eabc4 with Priority: HIGHEST for action security_group_members [ 1053.200773] env[65337]: INFO networking_nsxv3.common.synchronization [req-daed0a1a-ece2-4b09-8609-b1ec30453345 req-21617112-7f17-4493-954b-b4bc3fe2586f service nova] Enqueued Resource ID: 71070c08-123d-4587-ad53-5a8cecb1bb3d with Priority: HIGHEST for action port [ 1053.201138] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94a13e53-dcf7-4643-ade4-8789dc9eabc4 with Priority: HIGHEST for action security_group_rules [ 1053.201138] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94a13e53-dcf7-4643-ade4-8789dc9eabc4 with Priority: HIGHEST for action security_group_members [ 1053.201138] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71070c08-123d-4587-ad53-5a8cecb1bb3d with Priority: HIGHEST for action port [ 1053.201538] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-94a13e53-dcf7-4643-ade4-8789dc9eabc4 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.201538] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.201538] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.201715] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.201820] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('94a13e53-dcf7-4643-ade4-8789dc9eabc4',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.203398] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-94a13e53-dcf7-4643-ade4-8789dc9eabc4 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.203398] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.203398] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.203398] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.203398] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.203398] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.203398] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.204690] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.204690] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.204690] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('94a13e53-dcf7-4643-ade4-8789dc9eabc4',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.205128] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-71070c08-123d-4587-ad53-5a8cecb1bb3d taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.205128] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-71070c08-123d-4587-ad53-5a8cecb1bb3d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.205128] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-71070c08-123d-4587-ad53-5a8cecb1bb3d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.205287] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-71070c08-123d-4587-ad53-5a8cecb1bb3d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.205287] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('71070c08-123d-4587-ad53-5a8cecb1bb3d',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.207609] env[65337]: INFO networking_nsxv3.common.synchronization [req-2fdea5e5-12b3-45d4-8ea4-66d43b389480 req-ec9777aa-2322-4f12-96d3-bf0d0cbba91e service nova] Enqueued Resource ID: 653446ea-2b31-43b8-a920-884274265c75 with Priority: HIGHEST for action security_group_rules [ 1053.207684] env[65337]: INFO networking_nsxv3.common.synchronization [req-2fdea5e5-12b3-45d4-8ea4-66d43b389480 req-ec9777aa-2322-4f12-96d3-bf0d0cbba91e service nova] Enqueued Resource ID: 653446ea-2b31-43b8-a920-884274265c75 with Priority: HIGHEST for action security_group_members [ 1053.207814] env[65337]: INFO networking_nsxv3.common.synchronization [req-2fdea5e5-12b3-45d4-8ea4-66d43b389480 req-ec9777aa-2322-4f12-96d3-bf0d0cbba91e service nova] Enqueued Resource ID: 6f0b91e6-a13c-446b-ae15-f44016787f03 with Priority: HIGHEST for action port [ 1053.208186] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 653446ea-2b31-43b8-a920-884274265c75 with Priority: HIGHEST for action security_group_rules [ 1053.208314] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 653446ea-2b31-43b8-a920-884274265c75 with Priority: HIGHEST for action security_group_members [ 1053.208402] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f0b91e6-a13c-446b-ae15-f44016787f03 with Priority: HIGHEST for action port [ 1053.208880] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-653446ea-2b31-43b8-a920-884274265c75 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.209062] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.209268] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.209465] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.209465] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('653446ea-2b31-43b8-a920-884274265c75',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.210865] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-653446ea-2b31-43b8-a920-884274265c75 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.210865] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.210865] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-6f0b91e6-a13c-446b-ae15-f44016787f03 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.210865] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6f0b91e6-a13c-446b-ae15-f44016787f03" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.210865] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6f0b91e6-a13c-446b-ae15-f44016787f03" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.210865] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6f0b91e6-a13c-446b-ae15-f44016787f03" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.210865] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6f0b91e6-a13c-446b-ae15-f44016787f03',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.523774] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d in Status: SUCCESS [ 1053.524032] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.524220] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.524457] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.524730] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.524871] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.524871] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.525075] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.525168] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.525261] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.525356] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('161889a4-32a2-48ee-8fb7-d2a961a4b28d',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.707368] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('94a13e53-dcf7-4643-ade4-8789dc9eabc4',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.708898] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-94a13e53-dcf7-4643-ade4-8789dc9eabc4 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.709109] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.709648] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 71070c08-123d-4587-ad53-5a8cecb1bb3d with status ACTIVE [ 1053.709919] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.710215] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.710215] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.710553] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.710657] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.710928] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.711099] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.711411] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.711485] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.711598] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.711901] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.712073] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.712178] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.712418] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.712608] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.712917] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 71070c08-123d-4587-ad53-5a8cecb1bb3d is going to be updated. [ 1053.715027] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-653446ea-2b31-43b8-a920-884274265c75 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.715153] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.715431] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6f0b91e6-a13c-446b-ae15-f44016787f03 with status ACTIVE [ 1053.715811] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.715974] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.716379] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.716379] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.716493] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.716830] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.717090] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.717090] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.717334] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.717475] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.717773] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.717934] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.718241] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.718323] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.718423] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.719615] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6f0b91e6-a13c-446b-ae15-f44016787f03 is going to be updated. [ 1053.771795] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.772089] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.772258] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.772652] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.772904] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.773193] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-71070c08-123d-4587-ad53-5a8cecb1bb3d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.775167] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.775402] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.775649] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.775930] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.776170] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.776431] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6f0b91e6-a13c-446b-ae15-f44016787f03" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.027666] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-161889a4-32a2-48ee-8fb7-d2a961a4b28d taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.027961] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.027961] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.028295] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.028425] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.028536] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.028614] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.028774] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.028859] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.028961] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.029146] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-161889a4-32a2-48ee-8fb7-d2a961a4b28d taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.029250] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.029315] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.029466] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.029623] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.029723] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.029807] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.029920] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.030024] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.030112] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.030201] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('161889a4-32a2-48ee-8fb7-d2a961a4b28d',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.148723] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 653446ea-2b31-43b8-a920-884274265c75 in Status: SUCCESS [ 1054.149023] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 653446ea-2b31-43b8-a920-884274265c75 deletion is rescheduled due to dependency. [ 1054.149185] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.149399] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.149683] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.150029] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.150177] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.150229] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.150447] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.150557] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.150711] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('653446ea-2b31-43b8-a920-884274265c75',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.210425] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('94a13e53-dcf7-4643-ade4-8789dc9eabc4',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.533218] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 161889a4-32a2-48ee-8fb7-d2a961a4b28d: rpc.has_security_group_logging(os_id): False [ 1054.555062] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.555319] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.555319] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.555503] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.555688] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.555991] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.556257] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.556354] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.556532] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.556641] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.556877] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.556990] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.557894] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.558083] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.558171] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.558391] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.559677] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.559810] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.559991] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.560100] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.560196] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d is going to be updated. [ 1054.628052] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.628052] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.628052] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.628314] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.628314] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.640345] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d in Status: IN_PROGRESS for 2s [ 1054.653021] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('653446ea-2b31-43b8-a920-884274265c75',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.714065] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.714342] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.714342] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.714493] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.716494] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.716646] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 94a13e53-dcf7-4643-ade4-8789dc9eabc4 is going to be updated. [ 1054.758926] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.759170] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.759221] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.759428] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.759583] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.771015] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94a13e53-dcf7-4643-ade4-8789dc9eabc4 in Status: IN_PROGRESS for 2s [ 1055.155148] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('653446ea-2b31-43b8-a920-884274265c75',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.657323] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.657707] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.657707] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.658037] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.658037] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.658287] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 653446ea-2b31-43b8-a920-884274265c75 is going to be updated. [ 1055.703285] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.703385] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.703468] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.703708] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.703894] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.712810] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 653446ea-2b31-43b8-a920-884274265c75 in Status: IN_PROGRESS for 2s [ 1056.296144] env[65337]: INFO networking_nsxv3.common.synchronization [req-d5fb8b3c-29cf-472e-a30f-51a4f7646458 req-610b319f-33fa-477e-8005-a7acd3905160 tempest-ServersTestJSON-1910122825 tempest-ServersTestJSON-1910122825-project-member] Enqueued Resource ID: af1da677-d95a-4cec-95fa-b9208101b7dd with Priority: HIGHEST for action security_group_members [ 1056.300082] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af1da677-d95a-4cec-95fa-b9208101b7dd with Priority: HIGHEST for action security_group_members [ 1056.300979] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-af1da677-d95a-4cec-95fa-b9208101b7dd taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.301138] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.301205] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.301417] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.301573] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.301673] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.301778] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.301891] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.301978] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.302093] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('af1da677-d95a-4cec-95fa-b9208101b7dd',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.640031] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock network-48 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.640361] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "network-48" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.640436] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "network-48" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.640757] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "network-48" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.641096] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.641288] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.641429] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.641790] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.641873] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.642087] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1056.642233] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1056.642349] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1056.642480] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1056.642594] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1056.642731] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1056.642872] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1056.658064] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d in Status: SUCCESS [ 1056.658462] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.664144] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1056.664341] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1056.664500] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1056.664674] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "network-48" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.665008] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock port-e03a2a86-c13e-4988-a6f9-42b0c64dcd76 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.665205] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "port-e03a2a86-c13e-4988-a6f9-42b0c64dcd76" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.665349] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "port-e03a2a86-c13e-4988-a6f9-42b0c64dcd76" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.665687] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "port-e03a2a86-c13e-4988-a6f9-42b0c64dcd76" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.665866] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e03a2a86-c13e-4988-a6f9-42b0c64dcd76',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.781447] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94a13e53-dcf7-4643-ade4-8789dc9eabc4 in Status: SUCCESS [ 1056.781745] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.781930] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.782280] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.782437] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.782536] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.782596] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.782769] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.782854] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.782975] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.783091] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('94a13e53-dcf7-4643-ade4-8789dc9eabc4',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.804501] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('af1da677-d95a-4cec-95fa-b9208101b7dd',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.168721] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.169051] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.169206] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.169513] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.169667] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.169832] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Segment Port e03a2a86-c13e-4988-a6f9-42b0c64dcd76 not found, creating... [ 1057.170121] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.170277] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.170387] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.170605] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.170828] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.171226] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.171390] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.171505] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.171713] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.171868] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.173174] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Resource: SegmentPort with ID: e03a2a86-c13e-4988-a6f9-42b0c64dcd76 is going to be created. [ 1057.197597] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.197812] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.198017] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.198859] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.198859] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.199012] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "port-e03a2a86-c13e-4988-a6f9-42b0c64dcd76" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.285961] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-94a13e53-dcf7-4643-ade4-8789dc9eabc4 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.286216] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.286296] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.286539] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.286718] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.286820] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.286883] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.287050] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.287140] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.287234] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.287410] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-94a13e53-dcf7-4643-ade4-8789dc9eabc4 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.287515] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.287603] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.287793] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.287991] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.288157] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.288267] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.288488] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.288616] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.288733] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.288844] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('94a13e53-dcf7-4643-ade4-8789dc9eabc4',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.307075] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('af1da677-d95a-4cec-95fa-b9208101b7dd',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.723173] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 653446ea-2b31-43b8-a920-884274265c75 in Status: SUCCESS [ 1057.723469] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.723568] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.723772] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.723968] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.724095] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.724163] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.724305] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.724382] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.724467] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.724555] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('653446ea-2b31-43b8-a920-884274265c75',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.791596] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 94a13e53-dcf7-4643-ade4-8789dc9eabc4: rpc.has_security_group_logging(os_id): False [ 1057.809578] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.809966] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.809966] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.810179] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.810287] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.810391] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: af1da677-d95a-4cec-95fa-b9208101b7dd is going to be updated. [ 1057.849677] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.849677] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.849888] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.849939] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.850203] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.850296] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.850461] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.850528] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.850682] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.850782] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.851108] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.851214] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.851276] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.851399] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.851500] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.851723] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.851866] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.851955] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.852124] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.852202] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.852288] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 94a13e53-dcf7-4643-ade4-8789dc9eabc4 is going to be updated. [ 1057.867229] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.867471] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.867528] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.867745] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.867901] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.879443] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af1da677-d95a-4cec-95fa-b9208101b7dd in Status: IN_PROGRESS for 2s [ 1057.892663] env[65337]: INFO networking_nsxv3.common.synchronization [req-d5fb8b3c-29cf-472e-a30f-51a4f7646458 req-d8ce4a70-358f-46cb-9da1-aadc50cfda10 service nova] Enqueued Resource ID: af1da677-d95a-4cec-95fa-b9208101b7dd with Priority: HIGHEST for action security_group_rules [ 1057.892872] env[65337]: INFO networking_nsxv3.common.synchronization [req-d5fb8b3c-29cf-472e-a30f-51a4f7646458 req-d8ce4a70-358f-46cb-9da1-aadc50cfda10 service nova] Enqueued Resource ID: af1da677-d95a-4cec-95fa-b9208101b7dd with Priority: HIGHEST for action security_group_members [ 1057.893020] env[65337]: INFO networking_nsxv3.common.synchronization [req-d5fb8b3c-29cf-472e-a30f-51a4f7646458 req-d8ce4a70-358f-46cb-9da1-aadc50cfda10 service nova] Enqueued Resource ID: e03a2a86-c13e-4988-a6f9-42b0c64dcd76 with Priority: HIGHEST for action port [ 1057.893671] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af1da677-d95a-4cec-95fa-b9208101b7dd with Priority: HIGHEST for action security_group_rules [ 1057.893828] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af1da677-d95a-4cec-95fa-b9208101b7dd with Priority: HIGHEST for action security_group_members [ 1057.893937] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e03a2a86-c13e-4988-a6f9-42b0c64dcd76 with Priority: HIGHEST for action port [ 1057.894258] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-af1da677-d95a-4cec-95fa-b9208101b7dd taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.894388] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.894457] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.894673] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.894758] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('af1da677-d95a-4cec-95fa-b9208101b7dd',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.895705] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-af1da677-d95a-4cec-95fa-b9208101b7dd taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.895804] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.896018] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-e03a2a86-c13e-4988-a6f9-42b0c64dcd76 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.896151] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e03a2a86-c13e-4988-a6f9-42b0c64dcd76" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.896230] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e03a2a86-c13e-4988-a6f9-42b0c64dcd76" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.896410] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e03a2a86-c13e-4988-a6f9-42b0c64dcd76" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.896488] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e03a2a86-c13e-4988-a6f9-42b0c64dcd76',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.922230] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.922412] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.922491] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.922667] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.922798] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.939492] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 94a13e53-dcf7-4643-ade4-8789dc9eabc4 in Status: IN_PROGRESS for 2s [ 1058.227070] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-653446ea-2b31-43b8-a920-884274265c75 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.227246] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.227340] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.227542] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.227712] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.227814] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.227880] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.228052] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.228152] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.228224] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.228369] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-653446ea-2b31-43b8-a920-884274265c75 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.228459] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.228519] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.228657] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.228797] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.229030] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.229030] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.229126] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.229160] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.229244] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.229310] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('653446ea-2b31-43b8-a920-884274265c75',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.398740] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-af1da677-d95a-4cec-95fa-b9208101b7dd taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.398977] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.399171] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e03a2a86-c13e-4988-a6f9-42b0c64dcd76 with status ACTIVE [ 1058.399343] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.399455] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.399527] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.399727] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.399817] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.399999] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.400116] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.400177] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.400334] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.400411] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.400581] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.400674] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.400731] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.400865] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.400940] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.401035] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e03a2a86-c13e-4988-a6f9-42b0c64dcd76 is going to be updated. [ 1058.424870] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.424870] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.424870] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.424870] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.424870] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.425156] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e03a2a86-c13e-4988-a6f9-42b0c64dcd76" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.569992] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.570249] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.570363] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.570653] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.570773] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.732256] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 653446ea-2b31-43b8-a920-884274265c75: rpc.has_security_group_logging(os_id): False [ 1058.752371] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.752511] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.752591] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.752975] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.752975] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.753077] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.753198] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.753261] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.753372] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.753472] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.753756] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.753863] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.753923] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.754066] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.754132] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.754315] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.754405] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.754456] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.754584] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.754661] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.754745] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 653446ea-2b31-43b8-a920-884274265c75 is going to be updated. [ 1058.817049] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.817231] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.817285] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.817541] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.817738] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.829745] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 653446ea-2b31-43b8-a920-884274265c75 in Status: IN_PROGRESS for 2s [ 1059.074605] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.576781] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.891434] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af1da677-d95a-4cec-95fa-b9208101b7dd in Status: SUCCESS [ 1059.891782] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.891902] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.892142] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.892353] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.892476] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.892519] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.892682] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.892780] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.892914] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('af1da677-d95a-4cec-95fa-b9208101b7dd',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.956096] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 94a13e53-dcf7-4643-ade4-8789dc9eabc4 in Status: SUCCESS [ 1059.956342] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.079188] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1060.079416] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1060.395075] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('af1da677-d95a-4cec-95fa-b9208101b7dd',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.846837] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 653446ea-2b31-43b8-a920-884274265c75 in Status: SUCCESS [ 1060.847183] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.898867] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('af1da677-d95a-4cec-95fa-b9208101b7dd',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.014189] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.014429] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.014429] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.014840] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.029984] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1061.031013] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.032084] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1061.068411] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.068411] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.068411] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.068741] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.080969] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.081837] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1061.081947] env[65337]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65337) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1061.082045] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1061.120906] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.121185] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.121185] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.121338] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.122740] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.122910] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1061.207493] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.207668] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.207726] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.208111] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.208413] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.208671] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1061.282623] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.282861] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.282861] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.283048] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.283547] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.283865] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:44. [ 1061.283967] env[65337]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'653446ea-2b31-43b8-a920-884274265c75', 'e27d75d1-404e-406a-a69e-4560bd02b4cc', 'f1ba8c13-9b99-414f-9c5a-c8efc1ebc191', 'd8e2d833-6da9-488a-a2b1-f410f4205706', 'd9afc808-3692-46b5-a84b-018d8d2b7f94', '9e889ce7-965a-4de0-b096-60d4e743cf8b', 'af1da677-d95a-4cec-95fa-b9208101b7dd', '161889a4-32a2-48ee-8fb7-d2a961a4b28d', '755f030a-6e7c-43ec-adb9-cb4c270ad532', '8e29edb7-88ed-486f-9fa2-5fb50a0857b5', '7b634dce-1340-436a-a5af-e7d03954de92', '2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24', 'd4ff60fe-3407-42aa-b33c-6254779ad495', '7db87dc2-69af-45f1-90c2-f8a4ec96c3b7', 'd72090eb-ca70-4a65-8186-a5f4b40ed4cd', '8bec5c31-54b4-445a-a5e0-e51ba219c384', 'b11268ba-f3f9-4698-ae73-130361536d96', 'ee03c436-a01f-49f3-9012-42ca1b72c1d4', 'c62ada24-25f1-4b90-b0a4-d9a4254a91e6', '3cc33494-7b08-499a-b8bc-a9ae6b25d9d2', 'ebb204e1-ff28-4709-a165-ad95f8c27d8b', '287fa792-d512-4fba-b686-899daae58d0e', '40a56e89-d484-4891-85a5-afa67f87b2d1', '5289c470-2cbe-4957-bd37-f39138ab0a31', '3d8e0751-3115-433f-8b5b-b20068b58d27', '5e58c2df-9a0c-45bb-b4b3-676b4af3dc2c', '85232c6c-cd42-4a15-9924-943a4e75a091', '4f8577ef-eb55-481e-9197-98761298b164', 'a4c4fbaa-f4c9-4326-babb-bda6619acdf6', '4fe2934b-ab8b-4bda-9010-1a9725b2c40c', 'c5bec24d-89af-4b5e-920b-dcaae02501f0', 'cc860d7f-b6cd-4778-bbd7-a65ff0fc5bde', 'b2e84376-5c9f-45e7-9949-59bf17a96c95', 'a5a16fe4-8172-4f86-bfcd-dba6afcdd876', '5f3badd2-7106-4670-baaf-51e2d735f908', '34a3f5b1-e642-4184-95f7-7ad20ed36f5b', 'b5288296-022e-4f32-a68e-bdef9f09be4e', '61142fb1-6124-4f3b-93d1-d1ec51865066', '94a13e53-dcf7-4643-ade4-8789dc9eabc4', '5f51b41c-ca91-45cf-92a6-17398a529bbb', 'c26a679a-9c5d-4a72-b91b-bd7f21348ea0', 'a4a9546d-8cbc-404d-acef-d7856f353fbe', '12a747a0-2898-4059-bada-c453c5c41052', '6fd84ddb-97c2-4cc9-882e-251b1b1dd2f6'} {{(pid=65337) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1061.285036] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1061.305095] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.305095] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.305358] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.305358] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.305436] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.305547] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1061.305660] env[65337]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65337) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1061.305786] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1061.391664] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.391848] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.391902] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.392105] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.393222] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.393521] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1061.393583] env[65337]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65337) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1061.393779] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1061.393863] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1061.393911] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/44 resources of Type:Security Group Rules [ 1061.393983] env[65337]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 653446ea-2b31-43b8-a920-884274265c75 with Priority: HIGH for action security_group_rules [ 1061.394079] env[65337]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e27d75d1-404e-406a-a69e-4560bd02b4cc with Priority: HIGH for action security_group_rules [ 1061.394145] env[65337]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f1ba8c13-9b99-414f-9c5a-c8efc1ebc191 with Priority: HIGH for action security_group_rules [ 1061.394203] env[65337]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d8e2d833-6da9-488a-a2b1-f410f4205706 with Priority: HIGH for action security_group_rules [ 1061.394258] env[65337]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d9afc808-3692-46b5-a84b-018d8d2b7f94 with Priority: HIGH for action security_group_rules [ 1061.394313] env[65337]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9e889ce7-965a-4de0-b096-60d4e743cf8b with Priority: HIGH for action security_group_rules [ 1061.394361] env[65337]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: af1da677-d95a-4cec-95fa-b9208101b7dd with Priority: HIGH for action security_group_rules [ 1061.394422] env[65337]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d with Priority: HIGH for action security_group_rules [ 1061.394479] env[65337]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 755f030a-6e7c-43ec-adb9-cb4c270ad532 with Priority: HIGH for action security_group_rules [ 1061.394559] env[65337]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8e29edb7-88ed-486f-9fa2-5fb50a0857b5 with Priority: HIGH for action security_group_rules [ 1061.394637] env[65337]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7b634dce-1340-436a-a5af-e7d03954de92 with Priority: HIGH for action security_group_rules [ 1061.394734] env[65337]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24 with Priority: HIGH for action security_group_rules [ 1061.394798] env[65337]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d4ff60fe-3407-42aa-b33c-6254779ad495 with Priority: HIGH for action security_group_rules [ 1061.394880] env[65337]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 with Priority: HIGH for action security_group_rules [ 1061.394956] env[65337]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d72090eb-ca70-4a65-8186-a5f4b40ed4cd with Priority: HIGH for action security_group_rules [ 1061.395071] env[65337]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8bec5c31-54b4-445a-a5e0-e51ba219c384 with Priority: HIGH for action security_group_rules [ 1061.395183] env[65337]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b11268ba-f3f9-4698-ae73-130361536d96 with Priority: HIGH for action security_group_rules [ 1061.395260] env[65337]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ee03c436-a01f-49f3-9012-42ca1b72c1d4 with Priority: HIGH for action security_group_rules [ 1061.395336] env[65337]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c62ada24-25f1-4b90-b0a4-d9a4254a91e6 with Priority: HIGH for action security_group_rules [ 1061.395420] env[65337]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3cc33494-7b08-499a-b8bc-a9ae6b25d9d2 with Priority: HIGH for action security_group_rules [ 1061.395503] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.401273] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.401448] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.401501] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.401689] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.401774] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.401873] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: af1da677-d95a-4cec-95fa-b9208101b7dd is going to be updated. [ 1061.435556] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.435778] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.435851] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.436080] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.436231] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.445728] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af1da677-d95a-4cec-95fa-b9208101b7dd in Status: IN_PROGRESS for 2s [ 1062.895554] env[65337]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1062.895967] env[65337]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=2 [ 1062.895967] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 653446ea-2b31-43b8-a920-884274265c75 with Priority: HIGH for action security_group_rules [ 1062.896123] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1ba8c13-9b99-414f-9c5a-c8efc1ebc191 with Priority: HIGH for action security_group_rules [ 1062.896171] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af1da677-d95a-4cec-95fa-b9208101b7dd with Priority: HIGH for action security_group_rules [ 1062.896296] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d72090eb-ca70-4a65-8186-a5f4b40ed4cd with Priority: HIGH for action security_group_rules [ 1062.896399] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cc33494-7b08-499a-b8bc-a9ae6b25d9d2 with Priority: HIGH for action security_group_rules [ 1062.896546] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c62ada24-25f1-4b90-b0a4-d9a4254a91e6 with Priority: HIGH for action security_group_rules [ 1062.896675] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee03c436-a01f-49f3-9012-42ca1b72c1d4 with Priority: HIGH for action security_group_rules [ 1062.896774] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b11268ba-f3f9-4698-ae73-130361536d96 with Priority: HIGH for action security_group_rules [ 1062.896897] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 with Priority: HIGH for action security_group_rules [ 1062.897045] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8bec5c31-54b4-445a-a5e0-e51ba219c384 with Priority: HIGH for action security_group_rules [ 1062.897148] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4ff60fe-3407-42aa-b33c-6254779ad495 with Priority: HIGH for action security_group_rules [ 1062.897273] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24 with Priority: HIGH for action security_group_rules [ 1062.897470] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b634dce-1340-436a-a5af-e7d03954de92 with Priority: HIGH for action security_group_rules [ 1062.897514] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e29edb7-88ed-486f-9fa2-5fb50a0857b5 with Priority: HIGH for action security_group_rules [ 1062.897569] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 755f030a-6e7c-43ec-adb9-cb4c270ad532 with Priority: HIGH for action security_group_rules [ 1062.897698] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e889ce7-965a-4de0-b096-60d4e743cf8b with Priority: HIGH for action security_group_rules [ 1062.897815] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d with Priority: HIGH for action security_group_rules [ 1062.897908] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9afc808-3692-46b5-a84b-018d8d2b7f94 with Priority: HIGH for action security_group_rules [ 1062.898039] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e27d75d1-404e-406a-a69e-4560bd02b4cc with Priority: HIGH for action security_group_rules [ 1062.898188] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8e2d833-6da9-488a-a2b1-f410f4205706 with Priority: HIGH for action security_group_rules [ 1062.898605] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-653446ea-2b31-43b8-a920-884274265c75 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.898755] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.898911] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.899113] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.899218] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('653446ea-2b31-43b8-a920-884274265c75',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.900390] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f1ba8c13-9b99-414f-9c5a-c8efc1ebc191 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.900526] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f1ba8c13-9b99-414f-9c5a-c8efc1ebc191" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.900588] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f1ba8c13-9b99-414f-9c5a-c8efc1ebc191" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.900841] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f1ba8c13-9b99-414f-9c5a-c8efc1ebc191" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.900913] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f1ba8c13-9b99-414f-9c5a-c8efc1ebc191',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.901879] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-af1da677-d95a-4cec-95fa-b9208101b7dd taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.902011] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.902555] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d72090eb-ca70-4a65-8186-a5f4b40ed4cd taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.902781] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d72090eb-ca70-4a65-8186-a5f4b40ed4cd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.902781] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d72090eb-ca70-4a65-8186-a5f4b40ed4cd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.903149] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d72090eb-ca70-4a65-8186-a5f4b40ed4cd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.903149] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d72090eb-ca70-4a65-8186-a5f4b40ed4cd',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.904610] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3cc33494-7b08-499a-b8bc-a9ae6b25d9d2 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.904716] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3cc33494-7b08-499a-b8bc-a9ae6b25d9d2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.905073] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3cc33494-7b08-499a-b8bc-a9ae6b25d9d2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.905073] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3cc33494-7b08-499a-b8bc-a9ae6b25d9d2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.905073] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3cc33494-7b08-499a-b8bc-a9ae6b25d9d2',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.905844] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c62ada24-25f1-4b90-b0a4-d9a4254a91e6 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.905970] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c62ada24-25f1-4b90-b0a4-d9a4254a91e6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.906062] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c62ada24-25f1-4b90-b0a4-d9a4254a91e6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.906257] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c62ada24-25f1-4b90-b0a4-d9a4254a91e6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.906332] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c62ada24-25f1-4b90-b0a4-d9a4254a91e6',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.907084] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ee03c436-a01f-49f3-9012-42ca1b72c1d4 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.907229] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ee03c436-a01f-49f3-9012-42ca1b72c1d4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.907312] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ee03c436-a01f-49f3-9012-42ca1b72c1d4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.907438] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ee03c436-a01f-49f3-9012-42ca1b72c1d4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.907561] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ee03c436-a01f-49f3-9012-42ca1b72c1d4',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.908543] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b11268ba-f3f9-4698-ae73-130361536d96 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.908775] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b11268ba-f3f9-4698-ae73-130361536d96" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.908859] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b11268ba-f3f9-4698-ae73-130361536d96" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.909293] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b11268ba-f3f9-4698-ae73-130361536d96" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.909293] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b11268ba-f3f9-4698-ae73-130361536d96',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.909944] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.910100] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.910100] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.910220] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.910274] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7db87dc2-69af-45f1-90c2-f8a4ec96c3b7',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.910936] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8bec5c31-54b4-445a-a5e0-e51ba219c384 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.911092] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8bec5c31-54b4-445a-a5e0-e51ba219c384" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.911092] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8bec5c31-54b4-445a-a5e0-e51ba219c384" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.911491] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8bec5c31-54b4-445a-a5e0-e51ba219c384" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.911491] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8bec5c31-54b4-445a-a5e0-e51ba219c384',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.911936] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d4ff60fe-3407-42aa-b33c-6254779ad495 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.912165] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d4ff60fe-3407-42aa-b33c-6254779ad495" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.912235] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d4ff60fe-3407-42aa-b33c-6254779ad495" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.912376] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d4ff60fe-3407-42aa-b33c-6254779ad495" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.912451] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d4ff60fe-3407-42aa-b33c-6254779ad495',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.913187] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.913323] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.913323] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.913481] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.913536] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.914291] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7b634dce-1340-436a-a5af-e7d03954de92 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.914388] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7b634dce-1340-436a-a5af-e7d03954de92" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.914451] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7b634dce-1340-436a-a5af-e7d03954de92" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.914600] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7b634dce-1340-436a-a5af-e7d03954de92" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.914664] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7b634dce-1340-436a-a5af-e7d03954de92',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.915346] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8e29edb7-88ed-486f-9fa2-5fb50a0857b5 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.915443] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8e29edb7-88ed-486f-9fa2-5fb50a0857b5" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.915574] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8e29edb7-88ed-486f-9fa2-5fb50a0857b5" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.915685] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8e29edb7-88ed-486f-9fa2-5fb50a0857b5" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.915749] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8e29edb7-88ed-486f-9fa2-5fb50a0857b5',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.916511] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-755f030a-6e7c-43ec-adb9-cb4c270ad532 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.916633] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.916704] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.917103] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.917103] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('755f030a-6e7c-43ec-adb9-cb4c270ad532',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.917843] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9e889ce7-965a-4de0-b096-60d4e743cf8b taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.917843] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.918024] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.918069] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.918129] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9e889ce7-965a-4de0-b096-60d4e743cf8b',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.918892] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-161889a4-32a2-48ee-8fb7-d2a961a4b28d taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.918996] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.919070] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.919227] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.919293] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('161889a4-32a2-48ee-8fb7-d2a961a4b28d',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.920608] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d9afc808-3692-46b5-a84b-018d8d2b7f94 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.920726] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d9afc808-3692-46b5-a84b-018d8d2b7f94" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.920812] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d9afc808-3692-46b5-a84b-018d8d2b7f94" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.920928] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d9afc808-3692-46b5-a84b-018d8d2b7f94" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.921019] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d9afc808-3692-46b5-a84b-018d8d2b7f94',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.921674] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e27d75d1-404e-406a-a69e-4560bd02b4cc taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.921807] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e27d75d1-404e-406a-a69e-4560bd02b4cc" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.921884] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e27d75d1-404e-406a-a69e-4560bd02b4cc" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.922443] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e27d75d1-404e-406a-a69e-4560bd02b4cc" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.922512] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e27d75d1-404e-406a-a69e-4560bd02b4cc',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.923443] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d8e2d833-6da9-488a-a2b1-f410f4205706 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.923667] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d8e2d833-6da9-488a-a2b1-f410f4205706" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.923802] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d8e2d833-6da9-488a-a2b1-f410f4205706" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.923886] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d8e2d833-6da9-488a-a2b1-f410f4205706" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.923950] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d8e2d833-6da9-488a-a2b1-f410f4205706',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.949027] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.949285] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.949372] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.949533] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.973945] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.974570] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f1ba8c13-9b99-414f-9c5a-c8efc1ebc191 is going to be deleted. [ 1063.049537] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.049775] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.049775] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.050069] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.050129] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.050235] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f1ba8c13-9b99-414f-9c5a-c8efc1ebc191" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.430030] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-653446ea-2b31-43b8-a920-884274265c75 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.430030] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.430030] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.430030] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.430030] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.430030] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.430030] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.430030] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.430030] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.430030] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.431204] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('653446ea-2b31-43b8-a920-884274265c75',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.432804] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4ff60fe-3407-42aa-b33c-6254779ad495 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.433187] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4ff60fe-3407-42aa-b33c-6254779ad495" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.433472] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4ff60fe-3407-42aa-b33c-6254779ad495" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.433892] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4ff60fe-3407-42aa-b33c-6254779ad495" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.434384] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.435803] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.435803] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.435803] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.435803] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.435803] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4ff60fe-3407-42aa-b33c-6254779ad495" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.440050] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d4ff60fe-3407-42aa-b33c-6254779ad495',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.440050] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b634dce-1340-436a-a5af-e7d03954de92 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.440050] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b634dce-1340-436a-a5af-e7d03954de92" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.440050] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b634dce-1340-436a-a5af-e7d03954de92" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.440050] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b634dce-1340-436a-a5af-e7d03954de92" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.440050] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.440050] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.441030] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.441399] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.441688] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.442014] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b634dce-1340-436a-a5af-e7d03954de92" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.442363] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7b634dce-1340-436a-a5af-e7d03954de92',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.445335] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-161889a4-32a2-48ee-8fb7-d2a961a4b28d taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.445754] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.446321] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.446751] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.447181] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.447520] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.447876] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.448269] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.448556] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.448870] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.449212] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('161889a4-32a2-48ee-8fb7-d2a961a4b28d',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.456638] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-e27d75d1-404e-406a-a69e-4560bd02b4cc taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.457028] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e27d75d1-404e-406a-a69e-4560bd02b4cc" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.457304] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e27d75d1-404e-406a-a69e-4560bd02b4cc" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.457704] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e27d75d1-404e-406a-a69e-4560bd02b4cc" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.458144] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.458618] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.458879] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.461201] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.461201] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.461201] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e27d75d1-404e-406a-a69e-4560bd02b4cc" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.461201] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e27d75d1-404e-406a-a69e-4560bd02b4cc',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.468582] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-c62ada24-25f1-4b90-b0a4-d9a4254a91e6 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.470072] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c62ada24-25f1-4b90-b0a4-d9a4254a91e6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.470358] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c62ada24-25f1-4b90-b0a4-d9a4254a91e6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.471277] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c62ada24-25f1-4b90-b0a4-d9a4254a91e6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.471277] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.471705] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.473034] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.473034] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.473034] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.473034] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c62ada24-25f1-4b90-b0a4-d9a4254a91e6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.473034] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c62ada24-25f1-4b90-b0a4-d9a4254a91e6',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.490951] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e27d75d1-404e-406a-a69e-4560bd02b4cc',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.492670] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-161889a4-32a2-48ee-8fb7-d2a961a4b28d taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.492898] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.492898] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.493082] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.493231] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.493327] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.493401] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.493522] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.493597] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.493677] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.493818] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-161889a4-32a2-48ee-8fb7-d2a961a4b28d taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.493909] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.493974] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.494113] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.494248] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.494342] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.494404] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.494510] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.494573] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.494655] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.494767] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('161889a4-32a2-48ee-8fb7-d2a961a4b28d',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.495663] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7b634dce-1340-436a-a5af-e7d03954de92',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.496408] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d4ff60fe-3407-42aa-b33c-6254779ad495',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.528268] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.528493] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.528493] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.528693] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.530500] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.530673] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.542347] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af1da677-d95a-4cec-95fa-b9208101b7dd in Status: SUCCESS [ 1063.542570] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.542743] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.542955] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.543178] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.543317] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.543378] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.543535] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.543617] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.543747] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.543812] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('af1da677-d95a-4cec-95fa-b9208101b7dd',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.545536] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.545672] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.546408] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.546545] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.547575] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.547690] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.548611] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.548707] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.549621] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.549714] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.550432] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.550534] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.561148] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.561371] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.562820] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.562919] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.564667] env[65337]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1063.565195] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.565309] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.566311] env[65337]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1063.566692] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.566778] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.567357] env[65337]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1063.567732] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.567918] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8e29edb7-88ed-486f-9fa2-5fb50a0857b5 is going to be deleted. [ 1063.568706] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.568907] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.592940] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.593151] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d9afc808-3692-46b5-a84b-018d8d2b7f94 is going to be deleted. [ 1063.594221] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.594482] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.632611] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.632828] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7db87dc2-69af-45f1-90c2-f8a4ec96c3b7 is going to be deleted. [ 1063.633750] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.633983] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.655366] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.655539] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.656886] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.656886] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.668039] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.668039] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ee03c436-a01f-49f3-9012-42ca1b72c1d4 is going to be deleted. [ 1063.668249] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.669050] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.698638] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.698831] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 755f030a-6e7c-43ec-adb9-cb4c270ad532 is going to be deleted. [ 1063.699790] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.700045] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.752264] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.752477] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.786885] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.787193] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d72090eb-ca70-4a65-8186-a5f4b40ed4cd is going to be deleted. [ 1063.788140] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.788368] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.804450] env[65337]: INFO networking_nsxv3.common.synchronization [req-da762149-b4c0-475f-9e2b-111f34514739 req-dcedbd1e-6804-4aa9-8460-6c48e6ad9438 tempest-DeleteServersTestJSON-1654690426 tempest-DeleteServersTestJSON-1654690426-project-member] Enqueued Resource ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d with Priority: HIGHEST for action security_group_members [ 1063.807504] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d with Priority: HIGHEST for action security_group_members [ 1063.809090] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-161889a4-32a2-48ee-8fb7-d2a961a4b28d taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.809324] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.809477] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.809643] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.809839] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.809949] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.810034] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.810184] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.810273] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.810374] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('161889a4-32a2-48ee-8fb7-d2a961a4b28d',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.859058] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.859227] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.872362] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.872362] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d8e2d833-6da9-488a-a2b1-f410f4205706 is going to be deleted. [ 1063.873930] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.874168] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.874168] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.874362] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.874715] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.874715] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ee03c436-a01f-49f3-9012-42ca1b72c1d4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.874715] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.874978] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.938152] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.938503] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3cc33494-7b08-499a-b8bc-a9ae6b25d9d2 is going to be deleted. [ 1063.939326] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.939568] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.982582] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-653446ea-2b31-43b8-a920-884274265c75 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.982755] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.982841] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.983107] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.983283] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.983394] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.983915] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.983915] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.983915] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.983915] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.984277] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-653446ea-2b31-43b8-a920-884274265c75 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.984277] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.984277] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.984277] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.984476] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.984685] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.984685] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.984837] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.984837] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.984987] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.985095] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('653446ea-2b31-43b8-a920-884274265c75',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.986300] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c62ada24-25f1-4b90-b0a4-d9a4254a91e6',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.002087] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e27d75d1-404e-406a-a69e-4560bd02b4cc: rpc.has_security_group_logging(os_id): False [ 1064.003268] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d4ff60fe-3407-42aa-b33c-6254779ad495: rpc.has_security_group_logging(os_id): False [ 1064.004566] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 161889a4-32a2-48ee-8fb7-d2a961a4b28d: rpc.has_security_group_logging(os_id): False [ 1064.005429] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7b634dce-1340-436a-a5af-e7d03954de92: rpc.has_security_group_logging(os_id): False [ 1064.051994] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.052337] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9e889ce7-965a-4de0-b096-60d4e743cf8b is going to be deleted. [ 1064.053639] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-af1da677-d95a-4cec-95fa-b9208101b7dd taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.053936] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.053936] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.054496] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.054496] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.055380] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.055380] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.055380] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.055380] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.055380] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.055749] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-af1da677-d95a-4cec-95fa-b9208101b7dd taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.055749] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.055925] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.056055] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.056286] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.056429] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.056514] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.056753] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.056860] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.057030] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.057175] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('af1da677-d95a-4cec-95fa-b9208101b7dd',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.058889] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.058889] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.065747] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.065986] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.074371] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.074371] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.080058] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.080265] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.080895] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.081018] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.081636] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.081735] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.082096] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.082194] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.132359] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.132545] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8bec5c31-54b4-445a-a5e0-e51ba219c384 is going to be deleted. [ 1064.133801] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.134016] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.172734] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.172880] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.177122] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.177284] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b11268ba-f3f9-4698-ae73-130361536d96 is going to be deleted. [ 1064.178227] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.178437] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.178548] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.178654] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8e29edb7-88ed-486f-9fa2-5fb50a0857b5" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.178916] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.179057] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.179057] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.179315] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d9afc808-3692-46b5-a84b-018d8d2b7f94" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.179699] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.179907] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.180018] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.180119] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7db87dc2-69af-45f1-90c2-f8a4ec96c3b7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.180252] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.180396] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.180565] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.180614] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-755f030a-6e7c-43ec-adb9-cb4c270ad532" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.180717] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.180856] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.212099] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.212338] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.258275] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.258420] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24 is going to be deleted. [ 1064.259378] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.259592] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.259686] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.259802] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d72090eb-ca70-4a65-8186-a5f4b40ed4cd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.259993] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.260146] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.260218] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.260323] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d8e2d833-6da9-488a-a2b1-f410f4205706" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.261033] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.261172] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.313237] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.313677] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.338822] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.339754] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.408417] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.408900] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.409086] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.409229] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.409533] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.409680] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.409839] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d4ff60fe-3407-42aa-b33c-6254779ad495 is going to be updated. [ 1064.411400] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.411647] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.488965] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 653446ea-2b31-43b8-a920-884274265c75: rpc.has_security_group_logging(os_id): False [ 1064.490275] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c62ada24-25f1-4b90-b0a4-d9a4254a91e6: rpc.has_security_group_logging(os_id): False [ 1064.493722] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.494157] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.494276] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.494276] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.494459] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.494555] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.494861] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.495034] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.495089] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.495240] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.495323] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.495531] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.495606] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.495730] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.495868] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.495969] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.496141] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d is going to be updated. [ 1064.497359] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.497666] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.507877] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.508097] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.561327] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.561558] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.561809] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for af1da677-d95a-4cec-95fa-b9208101b7dd: rpc.has_security_group_logging(os_id): False [ 1064.594649] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.594936] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.618034] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.618201] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.628663] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.629025] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.629129] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.629197] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.629415] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.629512] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.629628] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7b634dce-1340-436a-a5af-e7d03954de92 is going to be updated. [ 1064.630951] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.631216] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.631368] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.631520] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9e889ce7-965a-4de0-b096-60d4e743cf8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.631672] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.631847] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.631949] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.632207] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.632345] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.632424] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.632603] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.632806] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.632918] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d is going to be updated. [ 1064.633931] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.634160] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.634294] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.634465] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8bec5c31-54b4-445a-a5e0-e51ba219c384" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.634628] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.634807] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.644761] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.644989] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.704167] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.704637] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.704759] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.704834] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.705133] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.705271] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.705426] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e27d75d1-404e-406a-a69e-4560bd02b4cc is going to be updated. [ 1064.706744] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.707054] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.707144] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.707291] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b11268ba-f3f9-4698-ae73-130361536d96" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.707465] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.707669] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.715720] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.715952] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.792239] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.792446] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.792509] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.792811] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.793150] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.810643] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.810927] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.813812] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.814044] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.814173] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.814248] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.814456] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.814579] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.815047] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.815423] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.815499] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.815776] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.815865] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.816091] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.816182] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.816222] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.816412] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.816488] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.816530] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 653446ea-2b31-43b8-a920-884274265c75 is going to be updated. [ 1064.817795] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.818026] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.850641] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d in Status: IN_PROGRESS for 2s [ 1064.898841] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.899088] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.908474] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.908904] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.909076] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.909140] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.909516] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.909640] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.909751] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c62ada24-25f1-4b90-b0a4-d9a4254a91e6 is going to be updated. [ 1064.911285] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.911509] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.998042] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.998525] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.999481] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.999900] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.000065] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.000065] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.000284] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.000443] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.000703] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.000860] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.000953] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.001218] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.001330] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.001624] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.001731] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.001848] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.002021] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.002117] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.002235] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: af1da677-d95a-4cec-95fa-b9208101b7dd is going to be updated. [ 1065.003728] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.003728] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.003988] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.005761] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.005761] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.005919] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.006982] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.007207] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.007311] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.007443] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3cc33494-7b08-499a-b8bc-a9ae6b25d9d2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.007607] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.007762] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.007931] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.009366] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.009548] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.009642] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.009781] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2dbbbd0d-f217-4fcb-ade0-607ef4e0eb24" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.010340] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.011213] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.011213] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.092472] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e27d75d1-404e-406a-a69e-4560bd02b4cc in Status: IN_PROGRESS for 2s [ 1065.105978] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d4ff60fe-3407-42aa-b33c-6254779ad495 in Status: IN_PROGRESS for 2s [ 1065.125531] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7b634dce-1340-436a-a5af-e7d03954de92 in Status: IN_PROGRESS for 2s [ 1065.127701] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d in Status: IN_PROGRESS for 2s [ 1065.156085] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.156085] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.156085] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.156085] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.156085] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.188820] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.188972] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.189051] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.189265] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.189407] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.240714] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 653446ea-2b31-43b8-a920-884274265c75 in Status: IN_PROGRESS for 2s [ 1065.277647] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c62ada24-25f1-4b90-b0a4-d9a4254a91e6 in Status: IN_PROGRESS for 2s [ 1065.278638] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.278638] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.278638] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.278893] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.278893] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.346822] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: af1da677-d95a-4cec-95fa-b9208101b7dd in Status: IN_PROGRESS for 2s [ 1065.684168] env[65337]: INFO networking_nsxv3.common.synchronization [req-fa4ff574-aa28-4b15-8aca-85e518536f5e req-b5997f5b-c941-4640-860d-cc7aaedf5901 tempest-ServerActionsTestOtherA-84911055 tempest-ServerActionsTestOtherA-84911055-project-member] Enqueued Resource ID: e27d75d1-404e-406a-a69e-4560bd02b4cc with Priority: HIGHEST for action security_group_members [ 1065.684893] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e27d75d1-404e-406a-a69e-4560bd02b4cc with Priority: HIGHEST for action security_group_members [ 1065.685246] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-e27d75d1-404e-406a-a69e-4560bd02b4cc taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.685390] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e27d75d1-404e-406a-a69e-4560bd02b4cc" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.685448] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e27d75d1-404e-406a-a69e-4560bd02b4cc" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.688113] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e27d75d1-404e-406a-a69e-4560bd02b4cc" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.688113] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.688113] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.688113] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.688113] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.688113] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.688113] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e27d75d1-404e-406a-a69e-4560bd02b4cc',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.189193] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.189567] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.189567] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.189733] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.189733] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.189971] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.191025] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.191377] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.191377] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.191603] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.191603] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e27d75d1-404e-406a-a69e-4560bd02b4cc is going to be updated. [ 1066.231067] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.232664] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.232664] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.232664] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.232664] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.242698] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e27d75d1-404e-406a-a69e-4560bd02b4cc in Status: IN_PROGRESS for 2s [ 1066.871743] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d in Status: SUCCESS [ 1066.871743] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d deletion is rescheduled due to dependency. [ 1066.871743] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.028978] env[65337]: INFO networking_nsxv3.common.synchronization [req-1125a726-a97c-403b-93fa-fd6a56d0bbec req-106844ff-6e58-4b55-b774-f9fdaba3a261 tempest-ServerDiskConfigTestJSON-1745593668 tempest-ServerDiskConfigTestJSON-1745593668-project-member] Enqueued Resource ID: 653446ea-2b31-43b8-a920-884274265c75 with Priority: HIGHEST for action security_group_members [ 1067.030016] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 653446ea-2b31-43b8-a920-884274265c75 with Priority: HIGHEST for action security_group_members [ 1067.030379] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-653446ea-2b31-43b8-a920-884274265c75 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.030504] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.030573] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.030768] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.030917] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.031059] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.031110] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.031226] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.031327] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.031436] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('653446ea-2b31-43b8-a920-884274265c75',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.105453] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e27d75d1-404e-406a-a69e-4560bd02b4cc in Status: SUCCESS [ 1067.105759] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e27d75d1-404e-406a-a69e-4560bd02b4cc" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.116643] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d4ff60fe-3407-42aa-b33c-6254779ad495 in Status: SUCCESS [ 1067.116944] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d4ff60fe-3407-42aa-b33c-6254779ad495" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.144365] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d in Status: SUCCESS [ 1067.144365] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.145729] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7b634dce-1340-436a-a5af-e7d03954de92 in Status: SUCCESS [ 1067.145930] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7b634dce-1340-436a-a5af-e7d03954de92" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.254525] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 653446ea-2b31-43b8-a920-884274265c75 in Status: SUCCESS [ 1067.255258] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.297103] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c62ada24-25f1-4b90-b0a4-d9a4254a91e6 in Status: SUCCESS [ 1067.297310] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c62ada24-25f1-4b90-b0a4-d9a4254a91e6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.366343] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: af1da677-d95a-4cec-95fa-b9208101b7dd in Status: SUCCESS [ 1067.366492] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.366719] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.367035] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.367136] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('af1da677-d95a-4cec-95fa-b9208101b7dd',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.535083] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.535083] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.535083] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.535083] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.535083] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.535463] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.535463] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.535463] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.535463] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.535636] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.535636] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 653446ea-2b31-43b8-a920-884274265c75 is going to be updated. [ 1067.587305] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.587797] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.587891] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.588219] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.588847] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.601567] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 653446ea-2b31-43b8-a920-884274265c75 in Status: IN_PROGRESS for 2s [ 1067.869530] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-af1da677-d95a-4cec-95fa-b9208101b7dd taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.869918] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.870633] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.870894] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.871104] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.871214] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.871280] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.871443] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.871570] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.871619] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.871697] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('af1da677-d95a-4cec-95fa-b9208101b7dd',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.253441] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e27d75d1-404e-406a-a69e-4560bd02b4cc in Status: SUCCESS [ 1068.253640] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e27d75d1-404e-406a-a69e-4560bd02b4cc deletion is rescheduled due to dependency. [ 1068.253761] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e27d75d1-404e-406a-a69e-4560bd02b4cc" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.374888] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-af1da677-d95a-4cec-95fa-b9208101b7dd taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.375200] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.375200] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.375351] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.375500] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.375592] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.375705] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.375915] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.376046] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.376117] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.376253] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-af1da677-d95a-4cec-95fa-b9208101b7dd taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.376343] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.376410] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.376541] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.376685] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.376838] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.376912] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.377069] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.377166] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.377275] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.377311] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('af1da677-d95a-4cec-95fa-b9208101b7dd',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.880074] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for af1da677-d95a-4cec-95fa-b9208101b7dd: rpc.has_security_group_logging(os_id): False [ 1068.901385] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.901602] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.901690] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.902086] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.902490] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.902554] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.902690] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.902802] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.903090] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.903234] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.903578] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.903747] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.903863] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.904079] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.904173] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.905085] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.905282] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.905407] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.905712] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.905856] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.906032] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: af1da677-d95a-4cec-95fa-b9208101b7dd is going to be updated. [ 1068.946114] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock network-250 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.946304] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "network-250" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.946379] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "network-250" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.946657] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "network-250" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.946947] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.947168] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.947291] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.948034] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.948034] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.948034] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1068.948034] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1068.948332] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1068.948332] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1068.948332] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1068.948467] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1068.948592] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1068.969609] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1068.969860] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1068.970080] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1068.970285] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "network-250" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.970717] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock port-71070c08-123d-4587-ad53-5a8cecb1bb3d taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.971012] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "port-71070c08-123d-4587-ad53-5a8cecb1bb3d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.971297] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "port-71070c08-123d-4587-ad53-5a8cecb1bb3d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.971635] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "port-71070c08-123d-4587-ad53-5a8cecb1bb3d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.971845] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('71070c08-123d-4587-ad53-5a8cecb1bb3d',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.982450] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.982627] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.982675] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.982914] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.983087] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.001031] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: af1da677-d95a-4cec-95fa-b9208101b7dd in Status: IN_PROGRESS for 2s [ 1069.475366] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.475790] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.475790] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.476187] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.476345] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.476699] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.476903] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.477093] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.477430] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.477593] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.477902] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.478093] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.478210] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.478512] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.478692] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.478863] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Resource: SegmentPort with ID: 71070c08-123d-4587-ad53-5a8cecb1bb3d is going to be updated. [ 1069.502468] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.502468] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.502762] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.502875] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.503086] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.503339] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "port-71070c08-123d-4587-ad53-5a8cecb1bb3d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.612644] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 653446ea-2b31-43b8-a920-884274265c75 in Status: SUCCESS [ 1069.612840] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 653446ea-2b31-43b8-a920-884274265c75 deletion is rescheduled due to dependency. [ 1069.613076] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.287689] env[65337]: INFO networking_nsxv3.common.synchronization [req-2c653b2a-79c3-41be-9285-30de4e11b795 req-ab77358b-2505-481c-a792-1a0289baded2 service nova] Enqueued Resource ID: 94a13e53-dcf7-4643-ade4-8789dc9eabc4 with Priority: HIGHEST for action security_group_rules [ 1070.287877] env[65337]: INFO networking_nsxv3.common.synchronization [req-2c653b2a-79c3-41be-9285-30de4e11b795 req-ab77358b-2505-481c-a792-1a0289baded2 service nova] Enqueued Resource ID: 94a13e53-dcf7-4643-ade4-8789dc9eabc4 with Priority: HIGHEST for action security_group_members [ 1070.288022] env[65337]: INFO networking_nsxv3.common.synchronization [req-2c653b2a-79c3-41be-9285-30de4e11b795 req-ab77358b-2505-481c-a792-1a0289baded2 service nova] Enqueued Resource ID: 71070c08-123d-4587-ad53-5a8cecb1bb3d with Priority: HIGHEST for action port [ 1070.288584] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94a13e53-dcf7-4643-ade4-8789dc9eabc4 with Priority: HIGHEST for action security_group_rules [ 1070.288712] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94a13e53-dcf7-4643-ade4-8789dc9eabc4 with Priority: HIGHEST for action security_group_members [ 1070.288800] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71070c08-123d-4587-ad53-5a8cecb1bb3d with Priority: HIGHEST for action port [ 1070.289145] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-94a13e53-dcf7-4643-ade4-8789dc9eabc4 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.289279] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.289342] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.289520] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.289591] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('94a13e53-dcf7-4643-ade4-8789dc9eabc4',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.292774] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-94a13e53-dcf7-4643-ade4-8789dc9eabc4 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.293244] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.293244] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.293430] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.295176] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.295176] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.295176] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.295176] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.295176] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.295176] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('94a13e53-dcf7-4643-ade4-8789dc9eabc4',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.299276] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-71070c08-123d-4587-ad53-5a8cecb1bb3d taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.299517] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-71070c08-123d-4587-ad53-5a8cecb1bb3d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.299640] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-71070c08-123d-4587-ad53-5a8cecb1bb3d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.299925] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-71070c08-123d-4587-ad53-5a8cecb1bb3d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.300073] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('71070c08-123d-4587-ad53-5a8cecb1bb3d',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.634780] env[65337]: INFO networking_nsxv3.common.synchronization [req-adf10881-a550-4c62-8fb7-4dd80d619dc2 req-c4676440-7aa5-49e7-94fa-a3cdb03ace96 tempest-ServersTestJSON-1910122825 tempest-ServersTestJSON-1910122825-project-member] Enqueued Resource ID: af1da677-d95a-4cec-95fa-b9208101b7dd with Priority: HIGHEST for action security_group_members [ 1070.635075] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af1da677-d95a-4cec-95fa-b9208101b7dd with Priority: HIGHEST for action security_group_members [ 1070.635394] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-af1da677-d95a-4cec-95fa-b9208101b7dd taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.635531] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.635575] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.635808] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.635970] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.636090] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.636153] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.636334] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.636423] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.636522] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('af1da677-d95a-4cec-95fa-b9208101b7dd',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.793428] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-94a13e53-dcf7-4643-ade4-8789dc9eabc4 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.793639] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.802133] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('94a13e53-dcf7-4643-ade4-8789dc9eabc4',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.803232] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 71070c08-123d-4587-ad53-5a8cecb1bb3d with status ACTIVE [ 1070.803485] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.803792] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.803889] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.804169] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.804273] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.804881] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.804881] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.804881] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.805109] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.805109] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.805293] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.805427] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.805471] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.805621] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.805820] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.805973] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 71070c08-123d-4587-ad53-5a8cecb1bb3d is going to be updated. [ 1070.845979] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.846187] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.846187] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.846380] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.846516] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.846942] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-71070c08-123d-4587-ad53-5a8cecb1bb3d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.018618] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: af1da677-d95a-4cec-95fa-b9208101b7dd in Status: SUCCESS [ 1071.018618] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.139400] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('af1da677-d95a-4cec-95fa-b9208101b7dd',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.309645] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('94a13e53-dcf7-4643-ade4-8789dc9eabc4',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.642241] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('af1da677-d95a-4cec-95fa-b9208101b7dd',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.812201] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.812545] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.812545] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.812729] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.812880] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.812989] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 94a13e53-dcf7-4643-ade4-8789dc9eabc4 is going to be updated. [ 1071.850012] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.850202] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.850256] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.850448] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.850590] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.873556] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94a13e53-dcf7-4643-ade4-8789dc9eabc4 in Status: IN_PROGRESS for 2s [ 1072.145469] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.145744] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.145864] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.146177] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.146222] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.146322] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: af1da677-d95a-4cec-95fa-b9208101b7dd is going to be updated. [ 1072.176119] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.176273] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.176340] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.176551] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.176722] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.201649] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af1da677-d95a-4cec-95fa-b9208101b7dd in Status: IN_PROGRESS for 2s [ 1073.884646] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94a13e53-dcf7-4643-ade4-8789dc9eabc4 in Status: SUCCESS [ 1073.885025] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.885099] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.885297] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.885576] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.885740] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.885812] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.885964] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.886058] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.886162] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.886262] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('94a13e53-dcf7-4643-ade4-8789dc9eabc4',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.212212] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af1da677-d95a-4cec-95fa-b9208101b7dd in Status: SUCCESS [ 1074.212434] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.389403] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-94a13e53-dcf7-4643-ade4-8789dc9eabc4 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.390154] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.390154] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.390297] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.390409] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.390563] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.390630] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.390750] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.390848] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.391039] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.391115] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-94a13e53-dcf7-4643-ade4-8789dc9eabc4 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.391215] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.391285] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.391428] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.391565] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.391731] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.391731] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.391926] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.391926] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.392054] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.392096] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('94a13e53-dcf7-4643-ade4-8789dc9eabc4',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.438089] env[65337]: INFO networking_nsxv3.common.synchronization [req-46a96b1d-2367-4fe4-b88f-2fef66a8c4ff req-f648d23e-9150-462d-a0c4-85425180fd80 tempest-ServerActionsTestOtherB-648353996 tempest-ServerActionsTestOtherB-648353996-project-member] Enqueued Resource ID: d4ff60fe-3407-42aa-b33c-6254779ad495 with Priority: HIGHEST for action security_group_members [ 1074.438614] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4ff60fe-3407-42aa-b33c-6254779ad495 with Priority: HIGHEST for action security_group_members [ 1074.438931] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4ff60fe-3407-42aa-b33c-6254779ad495 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.439060] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4ff60fe-3407-42aa-b33c-6254779ad495" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.439130] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4ff60fe-3407-42aa-b33c-6254779ad495" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.439321] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4ff60fe-3407-42aa-b33c-6254779ad495" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.439611] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.439611] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.439611] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.439776] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.439812] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.440071] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d4ff60fe-3407-42aa-b33c-6254779ad495',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.895994] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 94a13e53-dcf7-4643-ade4-8789dc9eabc4: rpc.has_security_group_logging(os_id): False [ 1074.936324] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.936554] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.936608] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.936863] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.944012] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.944201] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.980524] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.980524] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.980524] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.980524] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.980524] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.980524] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.980524] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.980524] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.980524] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.981215] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.981215] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.981215] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.981378] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.981450] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.981790] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.981925] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.982092] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 94a13e53-dcf7-4643-ade4-8789dc9eabc4 is going to be updated. [ 1074.983689] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.983951] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.984097] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.984557] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.984701] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.984795] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.984937] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.984992] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.985121] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d4ff60fe-3407-42aa-b33c-6254779ad495 is going to be updated. [ 1075.058022] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.058022] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.058022] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.058022] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.058022] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.087187] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4ff60fe-3407-42aa-b33c-6254779ad495 in Status: IN_PROGRESS for 2s [ 1075.143991] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.143991] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.143991] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.143991] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.144294] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.166744] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 94a13e53-dcf7-4643-ade4-8789dc9eabc4 in Status: IN_PROGRESS for 2s [ 1075.389102] env[65337]: INFO networking_nsxv3.common.synchronization [None req-2aded742-8ea0-4bf2-8942-7e1dfe1f49c7 tempest-ServerActionsTestJSON-704073373 tempest-ServerActionsTestJSON-704073373-project-member] Enqueued Resource ID: 2ad13511-d648-4224-8e48-ddf1ab1b8013 with Priority: HIGHEST for action security_group_rules [ 1075.389102] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ad13511-d648-4224-8e48-ddf1ab1b8013 with Priority: HIGHEST for action security_group_rules [ 1075.389460] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2ad13511-d648-4224-8e48-ddf1ab1b8013 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.389624] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2ad13511-d648-4224-8e48-ddf1ab1b8013" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.389720] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2ad13511-d648-4224-8e48-ddf1ab1b8013" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.390036] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2ad13511-d648-4224-8e48-ddf1ab1b8013" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.390635] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2ad13511-d648-4224-8e48-ddf1ab1b8013',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.496648] env[65337]: INFO networking_nsxv3.common.synchronization [None req-07c5c445-f147-4ca6-bb26-f7fd1330e026 tempest-ServerActionsTestJSON-704073373 tempest-ServerActionsTestJSON-704073373-project-member] Enqueued Resource ID: 2ad13511-d648-4224-8e48-ddf1ab1b8013 with Priority: HIGHEST for action security_group_rules [ 1075.497309] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ad13511-d648-4224-8e48-ddf1ab1b8013 with Priority: HIGHEST for action security_group_rules [ 1075.497516] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2ad13511-d648-4224-8e48-ddf1ab1b8013 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.497516] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2ad13511-d648-4224-8e48-ddf1ab1b8013" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.918756] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.919070] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.919070] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.919342] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.919411] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.919493] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2ad13511-d648-4224-8e48-ddf1ab1b8013 already deleted. [ 1075.919628] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2ad13511-d648-4224-8e48-ddf1ab1b8013" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.919798] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2ad13511-d648-4224-8e48-ddf1ab1b8013" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.919979] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2ad13511-d648-4224-8e48-ddf1ab1b8013" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.920537] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2ad13511-d648-4224-8e48-ddf1ab1b8013',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.273458] env[65337]: INFO networking_nsxv3.common.synchronization [req-85110cc0-685c-4db1-89a5-011a68e96d35 req-37ef0339-472e-4f05-ac9e-129a44879874 tempest-DeleteServersTestJSON-1654690426 tempest-DeleteServersTestJSON-1654690426-project-member] Enqueued Resource ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d with Priority: HIGHEST for action security_group_members [ 1076.274078] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d with Priority: HIGHEST for action security_group_members [ 1076.276553] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-161889a4-32a2-48ee-8fb7-d2a961a4b28d taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.276776] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.276776] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.277019] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.278417] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.278417] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.278417] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.278417] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.278417] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.278417] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('161889a4-32a2-48ee-8fb7-d2a961a4b28d',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.450717] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.450923] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.450962] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.451239] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.451239] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.451455] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2ad13511-d648-4224-8e48-ddf1ab1b8013 already deleted. [ 1076.451455] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2ad13511-d648-4224-8e48-ddf1ab1b8013" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.693167] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock network-211 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.693408] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "network-211" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.693490] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "network-211" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.693788] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "network-211" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.694239] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.695053] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.695053] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.695053] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.695258] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.695483] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1076.695634] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1076.695885] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1076.696016] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1076.696165] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1076.696318] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1076.696545] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1076.735210] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1076.735394] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Cache value generated in 0.039 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1076.735532] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1076.735771] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "network-211" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.736515] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock port-fd996d7a-b7e6-4dc2-9c34-8abf9f36b1f9 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.736515] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "port-fd996d7a-b7e6-4dc2-9c34-8abf9f36b1f9" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.736515] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "port-fd996d7a-b7e6-4dc2-9c34-8abf9f36b1f9" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.738162] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "port-fd996d7a-b7e6-4dc2-9c34-8abf9f36b1f9" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.738162] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fd996d7a-b7e6-4dc2-9c34-8abf9f36b1f9',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.780595] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.781095] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.781095] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.781095] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.781329] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.781405] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.781499] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.781564] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.781680] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.781752] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.781835] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d is going to be updated. [ 1076.847030] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.847226] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.847278] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.847454] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.847597] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.862390] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d in Status: IN_PROGRESS for 2s [ 1077.099961] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4ff60fe-3407-42aa-b33c-6254779ad495 in Status: SUCCESS [ 1077.099961] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d4ff60fe-3407-42aa-b33c-6254779ad495 deletion is rescheduled due to dependency. [ 1077.100510] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4ff60fe-3407-42aa-b33c-6254779ad495" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.181934] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 94a13e53-dcf7-4643-ade4-8789dc9eabc4 in Status: SUCCESS [ 1077.182115] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.239586] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.239928] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.239928] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.240306] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.240508] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.240695] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Segment Port fd996d7a-b7e6-4dc2-9c34-8abf9f36b1f9 not found, creating... [ 1077.241020] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.241217] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.241361] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.241622] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.241788] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.242133] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.242328] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.242477] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.242720] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.242898] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.243137] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Resource: SegmentPort with ID: fd996d7a-b7e6-4dc2-9c34-8abf9f36b1f9 is going to be created. [ 1077.286758] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.287016] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.287145] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.287428] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.287658] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.287879] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "port-fd996d7a-b7e6-4dc2-9c34-8abf9f36b1f9" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.482927] env[65337]: INFO networking_nsxv3.common.synchronization [req-ac8259b8-ae12-4dc6-aec9-6ed734159ea7 req-09cd00bf-0828-49f7-bd3a-db6564e2ae5b tempest-ServersTestJSON-380339010 tempest-ServersTestJSON-380339010-project-member] Enqueued Resource ID: 3d8e0751-3115-433f-8b5b-b20068b58d27 with Priority: HIGHEST for action security_group_members [ 1077.483655] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d8e0751-3115-433f-8b5b-b20068b58d27 with Priority: HIGHEST for action security_group_members [ 1077.484180] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d8e0751-3115-433f-8b5b-b20068b58d27 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.484348] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d8e0751-3115-433f-8b5b-b20068b58d27" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.484430] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d8e0751-3115-433f-8b5b-b20068b58d27" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.484679] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d8e0751-3115-433f-8b5b-b20068b58d27" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.484852] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.484956] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.485461] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.485461] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.485461] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.485461] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3d8e0751-3115-433f-8b5b-b20068b58d27',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.987711] env[65337]: INFO networking_nsxv3.common.synchronization [req-85110cc0-685c-4db1-89a5-011a68e96d35 req-c5e489d1-128a-4cc8-b498-5724765087a6 service nova] Enqueued Resource ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d with Priority: HIGHEST for action security_group_rules [ 1077.987907] env[65337]: INFO networking_nsxv3.common.synchronization [req-85110cc0-685c-4db1-89a5-011a68e96d35 req-c5e489d1-128a-4cc8-b498-5724765087a6 service nova] Enqueued Resource ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d with Priority: HIGHEST for action security_group_members [ 1077.988698] env[65337]: INFO networking_nsxv3.common.synchronization [req-85110cc0-685c-4db1-89a5-011a68e96d35 req-c5e489d1-128a-4cc8-b498-5724765087a6 service nova] Enqueued Resource ID: fd996d7a-b7e6-4dc2-9c34-8abf9f36b1f9 with Priority: HIGHEST for action port [ 1077.990906] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.991581] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.991681] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.991931] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.993678] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d with Priority: HIGHEST for action security_group_rules [ 1077.993775] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d with Priority: HIGHEST for action security_group_members [ 1077.994033] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd996d7a-b7e6-4dc2-9c34-8abf9f36b1f9 with Priority: HIGHEST for action port [ 1077.994719] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-161889a4-32a2-48ee-8fb7-d2a961a4b28d taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.994858] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.996058] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.996515] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.996515] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('161889a4-32a2-48ee-8fb7-d2a961a4b28d',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.997605] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-161889a4-32a2-48ee-8fb7-d2a961a4b28d taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.997852] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.998358] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-fd996d7a-b7e6-4dc2-9c34-8abf9f36b1f9 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.998358] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fd996d7a-b7e6-4dc2-9c34-8abf9f36b1f9" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.998585] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fd996d7a-b7e6-4dc2-9c34-8abf9f36b1f9" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.998903] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fd996d7a-b7e6-4dc2-9c34-8abf9f36b1f9" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.999461] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fd996d7a-b7e6-4dc2-9c34-8abf9f36b1f9',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.028405] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.028728] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.028893] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.028893] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.029407] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.029407] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.029407] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3d8e0751-3115-433f-8b5b-b20068b58d27 is going to be updated. [ 1078.063796] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.064681] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.064681] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.064681] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.064681] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.076076] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d8e0751-3115-433f-8b5b-b20068b58d27 in Status: IN_PROGRESS for 2s [ 1078.501768] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-161889a4-32a2-48ee-8fb7-d2a961a4b28d taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.502075] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.503284] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fd996d7a-b7e6-4dc2-9c34-8abf9f36b1f9 with status ACTIVE [ 1078.503486] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.503611] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.503697] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.503914] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.504014] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.504219] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.504305] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.504368] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.504519] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.504596] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.504771] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.504868] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.505028] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.505208] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.505310] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.505428] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fd996d7a-b7e6-4dc2-9c34-8abf9f36b1f9 is going to be updated. [ 1078.528795] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.529066] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.529066] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.529293] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.529377] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.529539] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fd996d7a-b7e6-4dc2-9c34-8abf9f36b1f9" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.874021] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d in Status: SUCCESS [ 1078.874249] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d deletion is rescheduled due to dependency. [ 1078.874375] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.874589] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.874877] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.875091] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.875212] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.875350] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.875431] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.875509] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.875735] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('161889a4-32a2-48ee-8fb7-d2a961a4b28d',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.378158] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('161889a4-32a2-48ee-8fb7-d2a961a4b28d',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.882416] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('161889a4-32a2-48ee-8fb7-d2a961a4b28d',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.087948] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d8e0751-3115-433f-8b5b-b20068b58d27 in Status: SUCCESS [ 1080.087948] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3d8e0751-3115-433f-8b5b-b20068b58d27 deletion is rescheduled due to dependency. [ 1080.087948] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d8e0751-3115-433f-8b5b-b20068b58d27" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.385997] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.385997] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.385997] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.386281] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.386281] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.386360] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d is going to be updated. [ 1080.424248] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.424248] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.424248] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.424821] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.424821] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.436305] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d in Status: IN_PROGRESS for 2s [ 1080.778297] env[65337]: INFO networking_nsxv3.common.synchronization [req-40da97c8-9955-46a3-9b56-5ccb52661d73 req-30ccf880-15de-4b19-9af3-48c4d8c0f566 tempest-ServerActionsTestOtherA-84911055 tempest-ServerActionsTestOtherA-84911055-project-member] Enqueued Resource ID: 61142fb1-6124-4f3b-93d1-d1ec51865066 with Priority: HIGHEST for action security_group_members [ 1080.779344] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61142fb1-6124-4f3b-93d1-d1ec51865066 with Priority: HIGHEST for action security_group_members [ 1080.779973] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-61142fb1-6124-4f3b-93d1-d1ec51865066 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.780212] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-61142fb1-6124-4f3b-93d1-d1ec51865066" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.780353] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-61142fb1-6124-4f3b-93d1-d1ec51865066" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.780660] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-61142fb1-6124-4f3b-93d1-d1ec51865066" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.781008] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.781220] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.781343] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.781654] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.781825] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.782020] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('61142fb1-6124-4f3b-93d1-d1ec51865066',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.182453] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock network-393 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.182751] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "network-393" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.183454] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "network-393" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.183832] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "network-393" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.184290] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.184558] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.186033] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.186033] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.186033] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.186033] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1081.186033] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1081.186401] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1081.186542] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1081.186731] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1081.186901] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1081.187133] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1081.211876] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1081.212140] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1081.212285] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1081.212468] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "network-393" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.212898] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock port-eeb51d6f-6746-40a3-aa4c-d6952c90a017 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.213109] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "port-eeb51d6f-6746-40a3-aa4c-d6952c90a017" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.213235] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "port-eeb51d6f-6746-40a3-aa4c-d6952c90a017" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.213562] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "port-eeb51d6f-6746-40a3-aa4c-d6952c90a017" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.214492] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eeb51d6f-6746-40a3-aa4c-d6952c90a017',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.286257] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.286789] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.286905] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.287253] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.300895] env[65337]: INFO networking_nsxv3.common.synchronization [req-f26733ec-be37-45d5-9b36-706b90898f07 req-33547259-e52c-4abd-bf39-b18da28312a7 tempest-ServersTestJSON-1910122825 tempest-ServersTestJSON-1910122825-project-member] Enqueued Resource ID: af1da677-d95a-4cec-95fa-b9208101b7dd with Priority: HIGHEST for action security_group_members [ 1081.301549] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af1da677-d95a-4cec-95fa-b9208101b7dd with Priority: HIGHEST for action security_group_members [ 1081.301974] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-af1da677-d95a-4cec-95fa-b9208101b7dd taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.302163] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.302237] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.302466] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.302819] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.302819] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.302962] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.303117] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.303217] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.303313] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('af1da677-d95a-4cec-95fa-b9208101b7dd',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.557340] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.557731] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.557827] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.557878] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.558154] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.558262] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.558361] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 61142fb1-6124-4f3b-93d1-d1ec51865066 is going to be updated. [ 1081.639503] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.639693] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.639764] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.640063] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.640265] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.679480] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 61142fb1-6124-4f3b-93d1-d1ec51865066 in Status: IN_PROGRESS for 2s [ 1081.717801] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.718123] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.718259] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.718547] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.718710] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.718852] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Segment Port eeb51d6f-6746-40a3-aa4c-d6952c90a017 not found, creating... [ 1081.719325] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.719719] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.719719] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.719828] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.719937] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.720327] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.720440] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.720787] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.720787] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.720888] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.721012] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Resource: SegmentPort with ID: eeb51d6f-6746-40a3-aa4c-d6952c90a017 is going to be created. [ 1081.753587] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.753587] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.753976] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.754193] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.754511] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.755085] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "port-eeb51d6f-6746-40a3-aa4c-d6952c90a017" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.809817] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('af1da677-d95a-4cec-95fa-b9208101b7dd',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.313597] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('af1da677-d95a-4cec-95fa-b9208101b7dd',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.447155] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d in Status: SUCCESS [ 1082.447386] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.447560] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.447772] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.448111] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.448258] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.448328] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.448496] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.448593] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.448659] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.448750] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('161889a4-32a2-48ee-8fb7-d2a961a4b28d',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.457688] env[65337]: INFO networking_nsxv3.common.synchronization [req-40da97c8-9955-46a3-9b56-5ccb52661d73 req-a38a7900-8488-4cba-9b10-d98843b23a40 service nova] Enqueued Resource ID: 61142fb1-6124-4f3b-93d1-d1ec51865066 with Priority: HIGHEST for action security_group_rules [ 1082.457899] env[65337]: INFO networking_nsxv3.common.synchronization [req-40da97c8-9955-46a3-9b56-5ccb52661d73 req-a38a7900-8488-4cba-9b10-d98843b23a40 service nova] Enqueued Resource ID: 61142fb1-6124-4f3b-93d1-d1ec51865066 with Priority: HIGHEST for action security_group_members [ 1082.458114] env[65337]: INFO networking_nsxv3.common.synchronization [req-40da97c8-9955-46a3-9b56-5ccb52661d73 req-a38a7900-8488-4cba-9b10-d98843b23a40 service nova] Enqueued Resource ID: eeb51d6f-6746-40a3-aa4c-d6952c90a017 with Priority: HIGHEST for action port [ 1082.458735] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61142fb1-6124-4f3b-93d1-d1ec51865066 with Priority: HIGHEST for action security_group_rules [ 1082.458919] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61142fb1-6124-4f3b-93d1-d1ec51865066 with Priority: HIGHEST for action security_group_members [ 1082.459206] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eeb51d6f-6746-40a3-aa4c-d6952c90a017 with Priority: HIGHEST for action port [ 1082.460375] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-61142fb1-6124-4f3b-93d1-d1ec51865066 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.460554] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-61142fb1-6124-4f3b-93d1-d1ec51865066" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.460644] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-61142fb1-6124-4f3b-93d1-d1ec51865066" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.460898] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-61142fb1-6124-4f3b-93d1-d1ec51865066" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.461033] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('61142fb1-6124-4f3b-93d1-d1ec51865066',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.463703] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-61142fb1-6124-4f3b-93d1-d1ec51865066 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.464101] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-61142fb1-6124-4f3b-93d1-d1ec51865066" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.464101] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-eeb51d6f-6746-40a3-aa4c-d6952c90a017 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.464251] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eeb51d6f-6746-40a3-aa4c-d6952c90a017" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.464304] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eeb51d6f-6746-40a3-aa4c-d6952c90a017" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.464450] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eeb51d6f-6746-40a3-aa4c-d6952c90a017" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.464526] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eeb51d6f-6746-40a3-aa4c-d6952c90a017',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.820081] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.820081] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.820081] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.820081] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.820081] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.820081] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: af1da677-d95a-4cec-95fa-b9208101b7dd is going to be updated. [ 1082.853713] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.853934] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.854000] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.854212] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.854546] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.864877] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af1da677-d95a-4cec-95fa-b9208101b7dd in Status: IN_PROGRESS for 2s [ 1082.951636] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-161889a4-32a2-48ee-8fb7-d2a961a4b28d taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.953044] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.953044] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.953044] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.954923] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.954923] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.954923] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.954923] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.954923] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.954923] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.954923] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-161889a4-32a2-48ee-8fb7-d2a961a4b28d taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.954923] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.954923] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.954923] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.954923] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.954923] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.954923] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.954923] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.954923] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.955756] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.955756] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('161889a4-32a2-48ee-8fb7-d2a961a4b28d',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.966689] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-61142fb1-6124-4f3b-93d1-d1ec51865066 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.966875] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-61142fb1-6124-4f3b-93d1-d1ec51865066" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.967348] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port eeb51d6f-6746-40a3-aa4c-d6952c90a017 with status ACTIVE [ 1082.967526] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.967687] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.967747] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.967989] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.968058] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.968254] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.968405] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.968405] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.968577] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.968653] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.968827] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.968925] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.968980] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.969119] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.969195] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.969269] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: eeb51d6f-6746-40a3-aa4c-d6952c90a017 is going to be updated. [ 1082.999026] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.999026] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.999026] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.999026] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.999346] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.999346] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eeb51d6f-6746-40a3-aa4c-d6952c90a017" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.459210] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 161889a4-32a2-48ee-8fb7-d2a961a4b28d: rpc.has_security_group_logging(os_id): False [ 1083.482325] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.482563] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.482563] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.482777] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.482866] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.483082] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.483182] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.483282] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.483439] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.483521] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.483751] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.484648] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.484648] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.484648] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.484648] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.484648] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.484929] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.484929] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.485106] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.485207] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.485316] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d is going to be updated. [ 1083.563535] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.564113] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.564218] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.564432] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.564627] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.604391] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d in Status: IN_PROGRESS for 2s [ 1083.694574] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 61142fb1-6124-4f3b-93d1-d1ec51865066 in Status: SUCCESS [ 1083.694806] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 61142fb1-6124-4f3b-93d1-d1ec51865066 deletion is rescheduled due to dependency. [ 1083.694880] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-61142fb1-6124-4f3b-93d1-d1ec51865066" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.695085] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-61142fb1-6124-4f3b-93d1-d1ec51865066" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.695370] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-61142fb1-6124-4f3b-93d1-d1ec51865066" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.695584] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.695709] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.695848] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.696069] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.696188] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.696265] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('61142fb1-6124-4f3b-93d1-d1ec51865066',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.199463] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('61142fb1-6124-4f3b-93d1-d1ec51865066',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.701459] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('61142fb1-6124-4f3b-93d1-d1ec51865066',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.835607] env[65337]: INFO networking_nsxv3.common.synchronization [req-36c553bf-ddcd-4916-b360-7ae2a7aaf668 req-3a8b0cd7-4cd0-4a69-b50e-3908cffe2ef0 tempest-ServerActionsTestJSON-704073373 tempest-ServerActionsTestJSON-704073373-project-member] Enqueued Resource ID: 2ad13511-d648-4224-8e48-ddf1ab1b8013 with Priority: HIGHEST for action security_group_members [ 1084.836429] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ad13511-d648-4224-8e48-ddf1ab1b8013 with Priority: HIGHEST for action security_group_members [ 1084.837199] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ad13511-d648-4224-8e48-ddf1ab1b8013 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.837871] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ad13511-d648-4224-8e48-ddf1ab1b8013" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.837949] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ad13511-d648-4224-8e48-ddf1ab1b8013" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.838494] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ad13511-d648-4224-8e48-ddf1ab1b8013" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.838715] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.838934] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.839260] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.839451] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.839752] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.840524] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2ad13511-d648-4224-8e48-ddf1ab1b8013',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.877257] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af1da677-d95a-4cec-95fa-b9208101b7dd in Status: SUCCESS [ 1084.877429] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.205764] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.207453] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.207453] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.207453] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.207453] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.207453] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 61142fb1-6124-4f3b-93d1-d1ec51865066 is going to be updated. [ 1085.244323] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.244459] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.244578] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.244818] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.244985] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.256110] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock network-433 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.256456] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "network-433" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.256688] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "network-433" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.257161] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "network-433" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.257613] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.257888] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.258070] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.258564] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.258564] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.258697] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1085.258830] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1085.258969] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1085.259109] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1085.259208] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1085.259322] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1085.259463] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1085.261209] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 61142fb1-6124-4f3b-93d1-d1ec51865066 in Status: IN_PROGRESS for 2s [ 1085.282259] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1085.282452] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1085.282594] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1085.282787] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "network-433" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.283167] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock port-69e1b922-6337-41c6-8181-3519c12632f0 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.283311] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "port-69e1b922-6337-41c6-8181-3519c12632f0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.283432] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "port-69e1b922-6337-41c6-8181-3519c12632f0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.283858] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "port-69e1b922-6337-41c6-8181-3519c12632f0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.284202] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('69e1b922-6337-41c6-8181-3519c12632f0',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.344912] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.345098] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.345180] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.345396] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.345486] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.345709] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.345862] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.345926] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.346125] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.346177] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.346263] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ad13511-d648-4224-8e48-ddf1ab1b8013 already deleted. [ 1085.346345] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ad13511-d648-4224-8e48-ddf1ab1b8013" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.627307] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d in Status: SUCCESS [ 1085.627527] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.787594] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.787972] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.788156] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.788598] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.788817] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.790106] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Segment Port 69e1b922-6337-41c6-8181-3519c12632f0 not found, creating... [ 1085.790106] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.790106] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.790106] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.790284] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.790455] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.790968] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.791139] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.791344] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.791654] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.791902] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.792092] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Resource: SegmentPort with ID: 69e1b922-6337-41c6-8181-3519c12632f0 is going to be created. [ 1085.814927] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.815176] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.815285] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.815569] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.815861] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.816112] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "port-69e1b922-6337-41c6-8181-3519c12632f0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.561797] env[65337]: INFO networking_nsxv3.common.synchronization [req-36c553bf-ddcd-4916-b360-7ae2a7aaf668 req-433dc70a-4fd5-43bf-8f8c-0e9d23d3a5ff service nova] Enqueued Resource ID: 2ad13511-d648-4224-8e48-ddf1ab1b8013 with Priority: HIGHEST for action security_group_rules [ 1086.561993] env[65337]: INFO networking_nsxv3.common.synchronization [req-36c553bf-ddcd-4916-b360-7ae2a7aaf668 req-433dc70a-4fd5-43bf-8f8c-0e9d23d3a5ff service nova] Enqueued Resource ID: 2ad13511-d648-4224-8e48-ddf1ab1b8013 with Priority: HIGHEST for action security_group_members [ 1086.562194] env[65337]: INFO networking_nsxv3.common.synchronization [req-36c553bf-ddcd-4916-b360-7ae2a7aaf668 req-433dc70a-4fd5-43bf-8f8c-0e9d23d3a5ff service nova] Enqueued Resource ID: 69e1b922-6337-41c6-8181-3519c12632f0 with Priority: HIGHEST for action port [ 1086.565559] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ad13511-d648-4224-8e48-ddf1ab1b8013 with Priority: HIGHEST for action security_group_rules [ 1086.565559] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ad13511-d648-4224-8e48-ddf1ab1b8013 with Priority: HIGHEST for action security_group_members [ 1086.565559] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69e1b922-6337-41c6-8181-3519c12632f0 with Priority: HIGHEST for action port [ 1086.565559] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2ad13511-d648-4224-8e48-ddf1ab1b8013 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.565559] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2ad13511-d648-4224-8e48-ddf1ab1b8013" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.565559] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2ad13511-d648-4224-8e48-ddf1ab1b8013" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.565559] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2ad13511-d648-4224-8e48-ddf1ab1b8013" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.565559] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2ad13511-d648-4224-8e48-ddf1ab1b8013',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.566283] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ad13511-d648-4224-8e48-ddf1ab1b8013 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.566283] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ad13511-d648-4224-8e48-ddf1ab1b8013" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.566283] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ad13511-d648-4224-8e48-ddf1ab1b8013" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.566574] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ad13511-d648-4224-8e48-ddf1ab1b8013" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.566620] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.566728] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.566803] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.567237] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.567237] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.567237] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2ad13511-d648-4224-8e48-ddf1ab1b8013',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.568889] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-69e1b922-6337-41c6-8181-3519c12632f0 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.569075] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-69e1b922-6337-41c6-8181-3519c12632f0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.569146] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-69e1b922-6337-41c6-8181-3519c12632f0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.569383] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-69e1b922-6337-41c6-8181-3519c12632f0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.569489] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('69e1b922-6337-41c6-8181-3519c12632f0',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.073313] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2ad13511-d648-4224-8e48-ddf1ab1b8013',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.077019] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ad13511-d648-4224-8e48-ddf1ab1b8013 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.077019] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ad13511-d648-4224-8e48-ddf1ab1b8013" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.077019] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 69e1b922-6337-41c6-8181-3519c12632f0 with status ACTIVE [ 1087.077019] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.077019] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.077019] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.077019] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.077019] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.077019] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.077019] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.077019] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.077019] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.077019] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.077019] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.077623] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.077623] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.077828] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.078031] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.078226] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 69e1b922-6337-41c6-8181-3519c12632f0 is going to be updated. [ 1087.112040] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.112040] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.112040] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.112040] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.112040] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.112040] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-69e1b922-6337-41c6-8181-3519c12632f0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.239444] env[65337]: INFO networking_nsxv3.common.synchronization [req-c2796cb4-19b3-4aa0-8037-f35158d21d5b req-05dd7e17-de54-41bc-9a7d-096c6fd5b824 tempest-AttachInterfacesTestJSON-1783062477 tempest-AttachInterfacesTestJSON-1783062477-project-member] Enqueued Resource ID: c62ada24-25f1-4b90-b0a4-d9a4254a91e6 with Priority: HIGHEST for action security_group_members [ 1087.240489] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c62ada24-25f1-4b90-b0a4-d9a4254a91e6 with Priority: HIGHEST for action security_group_members [ 1087.241596] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-c62ada24-25f1-4b90-b0a4-d9a4254a91e6 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.241596] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c62ada24-25f1-4b90-b0a4-d9a4254a91e6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.241596] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c62ada24-25f1-4b90-b0a4-d9a4254a91e6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.241596] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c62ada24-25f1-4b90-b0a4-d9a4254a91e6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.241596] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.241596] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.241596] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.241968] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.241968] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.241968] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c62ada24-25f1-4b90-b0a4-d9a4254a91e6',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.271554] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 61142fb1-6124-4f3b-93d1-d1ec51865066 in Status: SUCCESS [ 1087.271728] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-61142fb1-6124-4f3b-93d1-d1ec51865066" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.271890] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-61142fb1-6124-4f3b-93d1-d1ec51865066" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.272141] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-61142fb1-6124-4f3b-93d1-d1ec51865066" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.272344] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.272460] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.272766] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.272766] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.272899] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.272899] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-61142fb1-6124-4f3b-93d1-d1ec51865066" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.272982] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('61142fb1-6124-4f3b-93d1-d1ec51865066',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.552637] env[65337]: INFO networking_nsxv3.common.synchronization [None req-ad4ee6ed-b94f-46b4-9a16-e12d0d40b70f None None] Enqueued Resource ID: e20bb147-d94d-4d49-bf16-05e709acd9f1 with Priority: HIGHEST for action port [ 1087.552637] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e20bb147-d94d-4d49-bf16-05e709acd9f1 with Priority: HIGHEST for action port [ 1087.553545] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-e20bb147-d94d-4d49-bf16-05e709acd9f1 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.553902] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e20bb147-d94d-4d49-bf16-05e709acd9f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.555697] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e20bb147-d94d-4d49-bf16-05e709acd9f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.556080] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e20bb147-d94d-4d49-bf16-05e709acd9f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.556182] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e20bb147-d94d-4d49-bf16-05e709acd9f1',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.575634] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2ad13511-d648-4224-8e48-ddf1ab1b8013',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.745365] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c62ada24-25f1-4b90-b0a4-d9a4254a91e6',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.777491] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-61142fb1-6124-4f3b-93d1-d1ec51865066 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.777491] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-61142fb1-6124-4f3b-93d1-d1ec51865066" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.777491] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-61142fb1-6124-4f3b-93d1-d1ec51865066" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.777491] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-61142fb1-6124-4f3b-93d1-d1ec51865066" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.777491] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.777491] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.777491] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.777491] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.777491] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.777491] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-61142fb1-6124-4f3b-93d1-d1ec51865066" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.777491] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-61142fb1-6124-4f3b-93d1-d1ec51865066 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.777491] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-61142fb1-6124-4f3b-93d1-d1ec51865066" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.777491] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-61142fb1-6124-4f3b-93d1-d1ec51865066" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.777491] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-61142fb1-6124-4f3b-93d1-d1ec51865066" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.777491] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.777491] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.778140] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.778140] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.778140] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.778140] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-61142fb1-6124-4f3b-93d1-d1ec51865066" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.778140] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('61142fb1-6124-4f3b-93d1-d1ec51865066',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.781927] env[65337]: INFO networking_nsxv3.common.synchronization [req-3187af2e-b682-4e51-a574-976e8496e5ff req-ecf95385-2aa6-42b1-8374-9e39ea35f4ba tempest-ServerActionsTestOtherB-648353996 tempest-ServerActionsTestOtherB-648353996-project-member] Enqueued Resource ID: d4ff60fe-3407-42aa-b33c-6254779ad495 with Priority: HIGHEST for action security_group_members [ 1087.782759] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4ff60fe-3407-42aa-b33c-6254779ad495 with Priority: HIGHEST for action security_group_members [ 1087.783306] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4ff60fe-3407-42aa-b33c-6254779ad495 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.783555] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4ff60fe-3407-42aa-b33c-6254779ad495" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.783703] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4ff60fe-3407-42aa-b33c-6254779ad495" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.783969] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4ff60fe-3407-42aa-b33c-6254779ad495" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.784282] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.784502] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.784645] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.784901] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.785079] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.785244] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d4ff60fe-3407-42aa-b33c-6254779ad495',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.058781] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e20bb147-d94d-4d49-bf16-05e709acd9f1 [ 1088.059332] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.059332] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.059953] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.060221] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.062292] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.062292] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e20bb147-d94d-4d49-bf16-05e709acd9f1 already deleted. [ 1088.062292] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e20bb147-d94d-4d49-bf16-05e709acd9f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.078134] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.078608] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.078608] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.079825] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.079825] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.079825] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ad13511-d648-4224-8e48-ddf1ab1b8013 is going to be created. [ 1088.108454] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.108632] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.109169] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.109169] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.109169] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.125179] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ad13511-d648-4224-8e48-ddf1ab1b8013 in Status: UNINITIALIZED for 2s [ 1088.248150] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c62ada24-25f1-4b90-b0a4-d9a4254a91e6',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.249772] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock network-574 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.249963] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "network-574" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.254029] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "network-574" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.254029] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "network-574" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.254029] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.254029] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.254029] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.254029] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.254029] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.254029] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1088.254029] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1088.254029] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1088.254029] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1088.254029] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1088.254029] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1088.254029] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1088.275345] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1088.275518] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1088.275667] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1088.275906] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "network-574" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.276276] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock port-d98cb01f-bc3b-4a14-b7a0-7bbabcc9f1d2 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.276448] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "port-d98cb01f-bc3b-4a14-b7a0-7bbabcc9f1d2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.276573] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "port-d98cb01f-bc3b-4a14-b7a0-7bbabcc9f1d2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.276934] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "port-d98cb01f-bc3b-4a14-b7a0-7bbabcc9f1d2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.277454] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d98cb01f-bc3b-4a14-b7a0-7bbabcc9f1d2',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.283544] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 61142fb1-6124-4f3b-93d1-d1ec51865066: rpc.has_security_group_logging(os_id): False [ 1088.288040] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.288208] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.288277] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.289143] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.289143] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.289143] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.289143] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.289143] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.289143] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.289380] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.289380] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d4ff60fe-3407-42aa-b33c-6254779ad495 is going to be updated. [ 1088.313185] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.313444] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.313444] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.314425] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.314425] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.314425] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.314425] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.314425] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.314425] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.314425] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.314740] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.314740] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.314740] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.315490] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.315490] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.315490] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.315490] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.315679] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.315679] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.315770] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.315891] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 61142fb1-6124-4f3b-93d1-d1ec51865066 is going to be updated. [ 1088.329754] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.329915] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.329978] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.330211] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.330352] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.345911] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4ff60fe-3407-42aa-b33c-6254779ad495 in Status: IN_PROGRESS for 2s [ 1088.411311] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.411311] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.411486] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.411766] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.411766] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.426284] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 61142fb1-6124-4f3b-93d1-d1ec51865066 in Status: IN_PROGRESS for 2s [ 1088.756532] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.756742] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.756795] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.757120] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.757274] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.757406] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c62ada24-25f1-4b90-b0a4-d9a4254a91e6 is going to be updated. [ 1088.780867] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.780867] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.780867] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.781157] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.781754] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.781754] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Segment Port d98cb01f-bc3b-4a14-b7a0-7bbabcc9f1d2 not found, creating... [ 1088.781754] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.782247] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.782247] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.782354] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.782523] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.782765] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.782959] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.783076] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.783343] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.783492] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.783819] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Resource: SegmentPort with ID: d98cb01f-bc3b-4a14-b7a0-7bbabcc9f1d2 is going to be created. [ 1088.800071] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.800216] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.800297] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.800558] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.800716] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.808482] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.808684] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.808826] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.809090] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.809320] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.809544] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "port-d98cb01f-bc3b-4a14-b7a0-7bbabcc9f1d2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.812299] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c62ada24-25f1-4b90-b0a4-d9a4254a91e6 in Status: IN_PROGRESS for 2s [ 1089.561985] env[65337]: INFO networking_nsxv3.common.synchronization [req-3187af2e-b682-4e51-a574-976e8496e5ff req-279e9172-c4b1-4816-bcf1-895da667672a service nova] Enqueued Resource ID: d4ff60fe-3407-42aa-b33c-6254779ad495 with Priority: HIGHEST for action security_group_rules [ 1089.563102] env[65337]: INFO networking_nsxv3.common.synchronization [req-3187af2e-b682-4e51-a574-976e8496e5ff req-279e9172-c4b1-4816-bcf1-895da667672a service nova] Enqueued Resource ID: d4ff60fe-3407-42aa-b33c-6254779ad495 with Priority: HIGHEST for action security_group_members [ 1089.563102] env[65337]: INFO networking_nsxv3.common.synchronization [req-3187af2e-b682-4e51-a574-976e8496e5ff req-279e9172-c4b1-4816-bcf1-895da667672a service nova] Enqueued Resource ID: d98cb01f-bc3b-4a14-b7a0-7bbabcc9f1d2 with Priority: HIGHEST for action port [ 1089.564292] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4ff60fe-3407-42aa-b33c-6254779ad495 with Priority: HIGHEST for action security_group_rules [ 1089.567038] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4ff60fe-3407-42aa-b33c-6254779ad495 with Priority: HIGHEST for action security_group_members [ 1089.567038] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d98cb01f-bc3b-4a14-b7a0-7bbabcc9f1d2 with Priority: HIGHEST for action port [ 1089.567038] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d4ff60fe-3407-42aa-b33c-6254779ad495 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.567038] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d4ff60fe-3407-42aa-b33c-6254779ad495" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.567038] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d4ff60fe-3407-42aa-b33c-6254779ad495" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.567038] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d4ff60fe-3407-42aa-b33c-6254779ad495" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.567038] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d4ff60fe-3407-42aa-b33c-6254779ad495',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.567038] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4ff60fe-3407-42aa-b33c-6254779ad495 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.567038] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4ff60fe-3407-42aa-b33c-6254779ad495" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.567038] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-d98cb01f-bc3b-4a14-b7a0-7bbabcc9f1d2 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.567038] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d98cb01f-bc3b-4a14-b7a0-7bbabcc9f1d2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.567038] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d98cb01f-bc3b-4a14-b7a0-7bbabcc9f1d2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.567038] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d98cb01f-bc3b-4a14-b7a0-7bbabcc9f1d2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.567911] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d98cb01f-bc3b-4a14-b7a0-7bbabcc9f1d2',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.035839] env[65337]: INFO networking_nsxv3.common.synchronization [None req-4c76e243-b3c1-45f7-98d5-38b4360b6263 None None] Enqueued Resource ID: 3b6417be-2efa-480b-a93b-09efc5b8345e with Priority: HIGHEST for action port [ 1090.036405] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b6417be-2efa-480b-a93b-09efc5b8345e with Priority: HIGHEST for action port [ 1090.036723] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-3b6417be-2efa-480b-a93b-09efc5b8345e taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.037513] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3b6417be-2efa-480b-a93b-09efc5b8345e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.037513] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3b6417be-2efa-480b-a93b-09efc5b8345e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.037513] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3b6417be-2efa-480b-a93b-09efc5b8345e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.037513] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3b6417be-2efa-480b-a93b-09efc5b8345e',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.075893] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4ff60fe-3407-42aa-b33c-6254779ad495 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.075893] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4ff60fe-3407-42aa-b33c-6254779ad495" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.075893] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d98cb01f-bc3b-4a14-b7a0-7bbabcc9f1d2 with status ACTIVE [ 1090.075893] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.075893] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.075893] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.075893] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.075893] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.075893] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.075893] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.075893] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.076401] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.076401] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.076401] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.076489] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.077116] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.077116] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.077116] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.077116] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d98cb01f-bc3b-4a14-b7a0-7bbabcc9f1d2 is going to be updated. [ 1090.100034] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.100211] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.100299] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.100546] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.100704] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.101146] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d98cb01f-bc3b-4a14-b7a0-7bbabcc9f1d2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.137527] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ad13511-d648-4224-8e48-ddf1ab1b8013 in Status: SUCCESS [ 1090.137527] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ad13511-d648-4224-8e48-ddf1ab1b8013" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.137527] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ad13511-d648-4224-8e48-ddf1ab1b8013" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.137796] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ad13511-d648-4224-8e48-ddf1ab1b8013" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.138412] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.138412] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.138412] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.138412] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.138412] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.138412] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ad13511-d648-4224-8e48-ddf1ab1b8013" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.138832] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2ad13511-d648-4224-8e48-ddf1ab1b8013',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.357122] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4ff60fe-3407-42aa-b33c-6254779ad495 in Status: SUCCESS [ 1090.357420] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d4ff60fe-3407-42aa-b33c-6254779ad495 deletion is rescheduled due to dependency. [ 1090.357420] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4ff60fe-3407-42aa-b33c-6254779ad495" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.357572] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4ff60fe-3407-42aa-b33c-6254779ad495" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.357787] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4ff60fe-3407-42aa-b33c-6254779ad495" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.357969] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.358103] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.358185] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.358350] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.358433] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.358530] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d4ff60fe-3407-42aa-b33c-6254779ad495',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.443257] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 61142fb1-6124-4f3b-93d1-d1ec51865066 in Status: SUCCESS [ 1090.444238] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-61142fb1-6124-4f3b-93d1-d1ec51865066" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.539482] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3b6417be-2efa-480b-a93b-09efc5b8345e [ 1090.540014] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.540197] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.540274] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.540479] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.540650] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.540650] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3b6417be-2efa-480b-a93b-09efc5b8345e already deleted. [ 1090.540752] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3b6417be-2efa-480b-a93b-09efc5b8345e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.640786] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2ad13511-d648-4224-8e48-ddf1ab1b8013',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.730022] env[65337]: INFO networking_nsxv3.common.synchronization [req-a4abce67-0241-4982-8bdb-c5c8493c6cc0 req-05ec9db7-8240-4e3f-99a8-b0c60f403df2 tempest-ServerActionsTestOtherA-84911055 tempest-ServerActionsTestOtherA-84911055-project-member] Enqueued Resource ID: 61142fb1-6124-4f3b-93d1-d1ec51865066 with Priority: HIGHEST for action security_group_members [ 1090.730894] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61142fb1-6124-4f3b-93d1-d1ec51865066 with Priority: HIGHEST for action security_group_members [ 1090.731382] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-61142fb1-6124-4f3b-93d1-d1ec51865066 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.731382] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-61142fb1-6124-4f3b-93d1-d1ec51865066" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.731554] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-61142fb1-6124-4f3b-93d1-d1ec51865066" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.731621] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-61142fb1-6124-4f3b-93d1-d1ec51865066" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.731823] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.731921] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.732500] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.732500] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.732500] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.732500] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('61142fb1-6124-4f3b-93d1-d1ec51865066',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.778958] env[65337]: INFO networking_nsxv3.common.synchronization [req-a4abce67-0241-4982-8bdb-c5c8493c6cc0 req-05ec9db7-8240-4e3f-99a8-b0c60f403df2 tempest-ServerActionsTestOtherA-84911055 tempest-ServerActionsTestOtherA-84911055-project-member] Enqueued Resource ID: eeb51d6f-6746-40a3-aa4c-d6952c90a017 with Priority: HIGHEST for action port [ 1090.779538] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eeb51d6f-6746-40a3-aa4c-d6952c90a017 with Priority: HIGHEST for action port [ 1090.779857] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-eeb51d6f-6746-40a3-aa4c-d6952c90a017 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.779986] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eeb51d6f-6746-40a3-aa4c-d6952c90a017" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.780102] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eeb51d6f-6746-40a3-aa4c-d6952c90a017" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.780279] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eeb51d6f-6746-40a3-aa4c-d6952c90a017" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.780363] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eeb51d6f-6746-40a3-aa4c-d6952c90a017',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.824806] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c62ada24-25f1-4b90-b0a4-d9a4254a91e6 in Status: SUCCESS [ 1090.824806] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c62ada24-25f1-4b90-b0a4-d9a4254a91e6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.860646] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d4ff60fe-3407-42aa-b33c-6254779ad495',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.143396] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2ad13511-d648-4224-8e48-ddf1ab1b8013: rpc.has_security_group_logging(os_id): False [ 1091.164329] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.164499] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.164563] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.164778] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.164868] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.165188] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.165296] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.165360] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.165518] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.165618] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.165676] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2ad13511-d648-4224-8e48-ddf1ab1b8013 is going to be created. [ 1091.227468] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.227468] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.227468] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.227661] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.228094] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.234455] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.234634] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.234677] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.234957] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.235142] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.235360] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.235473] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.235524] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.236099] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.236099] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.236099] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 61142fb1-6124-4f3b-93d1-d1ec51865066 is going to be updated. [ 1091.240361] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2ad13511-d648-4224-8e48-ddf1ab1b8013 in Status: IN_PROGRESS for 2s [ 1091.262045] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.262216] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.262384] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.262579] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.262724] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.273580] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 61142fb1-6124-4f3b-93d1-d1ec51865066 in Status: IN_PROGRESS for 2s [ 1091.283151] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port eeb51d6f-6746-40a3-aa4c-d6952c90a017 with status ACTIVE [ 1091.284403] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.284403] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.284403] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.284403] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.284403] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.284403] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.284726] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.284726] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.284726] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.284842] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.285078] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.285556] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.285556] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.285556] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.285556] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.285707] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: eeb51d6f-6746-40a3-aa4c-d6952c90a017 is going to be updated. [ 1091.333353] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.333353] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.333353] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.333582] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.333767] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.333846] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eeb51d6f-6746-40a3-aa4c-d6952c90a017" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.364449] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d4ff60fe-3407-42aa-b33c-6254779ad495',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.867196] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.867714] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.867714] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.867714] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.868024] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.868024] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d4ff60fe-3407-42aa-b33c-6254779ad495 is going to be updated. [ 1091.914619] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.915281] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.915281] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.915281] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.915281] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.924922] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4ff60fe-3407-42aa-b33c-6254779ad495 in Status: IN_PROGRESS for 2s [ 1093.252720] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2ad13511-d648-4224-8e48-ddf1ab1b8013 in Status: SUCCESS [ 1093.253030] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2ad13511-d648-4224-8e48-ddf1ab1b8013" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.284585] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 61142fb1-6124-4f3b-93d1-d1ec51865066 in Status: SUCCESS [ 1093.284979] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 61142fb1-6124-4f3b-93d1-d1ec51865066 deletion is rescheduled due to dependency. [ 1093.285223] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-61142fb1-6124-4f3b-93d1-d1ec51865066" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.453545] env[65337]: INFO networking_nsxv3.common.synchronization [req-74a0370b-ba96-4d88-99bc-60534b86fc6f req-9d4ddf6a-468f-4e0f-885c-42b160554baf tempest-AttachInterfacesTestJSON-1783062477 tempest-AttachInterfacesTestJSON-1783062477-project-member] Enqueued Resource ID: c62ada24-25f1-4b90-b0a4-d9a4254a91e6 with Priority: HIGHEST for action security_group_members [ 1093.454200] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c62ada24-25f1-4b90-b0a4-d9a4254a91e6 with Priority: HIGHEST for action security_group_members [ 1093.454663] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-c62ada24-25f1-4b90-b0a4-d9a4254a91e6 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.454801] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c62ada24-25f1-4b90-b0a4-d9a4254a91e6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.454874] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c62ada24-25f1-4b90-b0a4-d9a4254a91e6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.455095] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c62ada24-25f1-4b90-b0a4-d9a4254a91e6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.455253] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.455350] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.455411] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.455553] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.455636] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.455730] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c62ada24-25f1-4b90-b0a4-d9a4254a91e6',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.936556] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4ff60fe-3407-42aa-b33c-6254779ad495 in Status: SUCCESS [ 1093.936556] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4ff60fe-3407-42aa-b33c-6254779ad495" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.936795] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4ff60fe-3407-42aa-b33c-6254779ad495" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.937147] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4ff60fe-3407-42aa-b33c-6254779ad495" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.937372] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.937570] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.937570] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.937761] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.937856] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.937928] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4ff60fe-3407-42aa-b33c-6254779ad495" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.938230] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d4ff60fe-3407-42aa-b33c-6254779ad495',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.958717] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.958717] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.958717] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.958949] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.959121] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.959408] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.959583] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.959687] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.960098] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.960216] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.960363] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c62ada24-25f1-4b90-b0a4-d9a4254a91e6 is going to be updated. [ 1094.012929] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.013183] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.013270] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.013437] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.013586] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.036089] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c62ada24-25f1-4b90-b0a4-d9a4254a91e6 in Status: IN_PROGRESS for 2s [ 1094.441199] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d4ff60fe-3407-42aa-b33c-6254779ad495',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.585941] env[65337]: INFO networking_nsxv3.common.synchronization [req-adb6ca59-7cd7-4114-8c5e-3c34a17a0f2f req-874bd5fb-f74b-4000-93c3-66e20f54cea9 tempest-ServersTestJSON-1910122825 tempest-ServersTestJSON-1910122825-project-member] Enqueued Resource ID: af1da677-d95a-4cec-95fa-b9208101b7dd with Priority: HIGHEST for action security_group_members [ 1094.586650] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af1da677-d95a-4cec-95fa-b9208101b7dd with Priority: HIGHEST for action security_group_members [ 1094.587023] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-af1da677-d95a-4cec-95fa-b9208101b7dd taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.587174] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.587211] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.587399] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.587583] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.587688] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.587688] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.587831] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.587899] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.588024] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('af1da677-d95a-4cec-95fa-b9208101b7dd',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.944426] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d4ff60fe-3407-42aa-b33c-6254779ad495: rpc.has_security_group_logging(os_id): False [ 1094.967617] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.967785] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.968034] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.968166] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.968230] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.968518] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.968641] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.968705] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.968878] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.968961] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.969057] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d4ff60fe-3407-42aa-b33c-6254779ad495 is going to be updated. [ 1094.994022] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock network-48 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.994022] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "network-48" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.994022] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "network-48" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.994022] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "network-48" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.995458] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.995458] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.995458] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.995756] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.995756] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.995896] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1094.996070] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1094.996763] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1094.996763] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1094.996763] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1094.996763] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1094.996763] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1095.020037] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1095.020037] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1095.020219] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1095.020453] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "network-48" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.020790] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock port-5203f6bf-4d08-41c7-b337-a851dcebdb84 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.020970] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "port-5203f6bf-4d08-41c7-b337-a851dcebdb84" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.021171] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "port-5203f6bf-4d08-41c7-b337-a851dcebdb84" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.021639] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "port-5203f6bf-4d08-41c7-b337-a851dcebdb84" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.021826] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5203f6bf-4d08-41c7-b337-a851dcebdb84',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.045727] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.045944] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.046037] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.046237] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.046383] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.063477] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d4ff60fe-3407-42aa-b33c-6254779ad495 in Status: IN_PROGRESS for 2s [ 1095.091553] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('af1da677-d95a-4cec-95fa-b9208101b7dd',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.524723] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.525086] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.525753] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.526371] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.526536] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.526714] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Segment Port 5203f6bf-4d08-41c7-b337-a851dcebdb84 not found, creating... [ 1095.527066] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.527273] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.527411] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.527660] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.527800] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.528377] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.528556] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.528674] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.529070] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.529142] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.529370] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Resource: SegmentPort with ID: 5203f6bf-4d08-41c7-b337-a851dcebdb84 is going to be created. [ 1095.554234] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.554453] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.554578] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.554852] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.555171] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.555443] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "port-5203f6bf-4d08-41c7-b337-a851dcebdb84" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.593416] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('af1da677-d95a-4cec-95fa-b9208101b7dd',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.053639] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c62ada24-25f1-4b90-b0a4-d9a4254a91e6 in Status: SUCCESS [ 1096.054428] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c62ada24-25f1-4b90-b0a4-d9a4254a91e6 deletion is rescheduled due to dependency. [ 1096.054428] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c62ada24-25f1-4b90-b0a4-d9a4254a91e6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.097916] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.098084] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.098131] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.100026] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.100026] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.100026] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: af1da677-d95a-4cec-95fa-b9208101b7dd is going to be updated. [ 1096.133168] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.133399] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.133525] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.133865] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.134146] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.147244] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af1da677-d95a-4cec-95fa-b9208101b7dd in Status: IN_PROGRESS for 2s [ 1096.305600] env[65337]: INFO networking_nsxv3.common.synchronization [req-adb6ca59-7cd7-4114-8c5e-3c34a17a0f2f req-3f7c899d-2744-42c2-818d-8cfbd631a6e9 service nova] Enqueued Resource ID: af1da677-d95a-4cec-95fa-b9208101b7dd with Priority: HIGHEST for action security_group_rules [ 1096.305777] env[65337]: INFO networking_nsxv3.common.synchronization [req-adb6ca59-7cd7-4114-8c5e-3c34a17a0f2f req-3f7c899d-2744-42c2-818d-8cfbd631a6e9 service nova] Enqueued Resource ID: af1da677-d95a-4cec-95fa-b9208101b7dd with Priority: HIGHEST for action security_group_members [ 1096.306139] env[65337]: INFO networking_nsxv3.common.synchronization [req-adb6ca59-7cd7-4114-8c5e-3c34a17a0f2f req-3f7c899d-2744-42c2-818d-8cfbd631a6e9 service nova] Enqueued Resource ID: 5203f6bf-4d08-41c7-b337-a851dcebdb84 with Priority: HIGHEST for action port [ 1096.306694] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af1da677-d95a-4cec-95fa-b9208101b7dd with Priority: HIGHEST for action security_group_rules [ 1096.306832] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af1da677-d95a-4cec-95fa-b9208101b7dd with Priority: HIGHEST for action security_group_members [ 1096.307120] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5203f6bf-4d08-41c7-b337-a851dcebdb84 with Priority: HIGHEST for action port [ 1096.307515] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-af1da677-d95a-4cec-95fa-b9208101b7dd taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.307687] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.307803] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.308092] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.308216] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('af1da677-d95a-4cec-95fa-b9208101b7dd',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.309240] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-af1da677-d95a-4cec-95fa-b9208101b7dd taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.309383] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.309657] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-5203f6bf-4d08-41c7-b337-a851dcebdb84 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.309794] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5203f6bf-4d08-41c7-b337-a851dcebdb84" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.309890] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5203f6bf-4d08-41c7-b337-a851dcebdb84" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.310079] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5203f6bf-4d08-41c7-b337-a851dcebdb84" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.310206] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5203f6bf-4d08-41c7-b337-a851dcebdb84',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.812500] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-af1da677-d95a-4cec-95fa-b9208101b7dd taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.812960] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.815392] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5203f6bf-4d08-41c7-b337-a851dcebdb84 with status ACTIVE [ 1096.815392] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.815392] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.815392] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.815392] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.815392] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.815392] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.815392] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.815392] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.815392] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.815392] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.816409] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.816409] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.816409] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.816409] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.816409] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.816409] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5203f6bf-4d08-41c7-b337-a851dcebdb84 is going to be updated. [ 1096.850715] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.850918] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.850918] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.851144] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.851283] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.851446] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5203f6bf-4d08-41c7-b337-a851dcebdb84" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.979466] env[65337]: INFO networking_nsxv3.common.synchronization [req-82df8429-de1c-4668-a45e-761c7fc2b59a req-dab2d6c6-6197-49b5-bf23-d23e41af56ce tempest-ServersTestMultiNic-1422308133 tempest-ServersTestMultiNic-1422308133-project-member] Enqueued Resource ID: 740ecd60-f1c6-4713-b339-481a878486f1 with Priority: HIGHEST for action security_group_members [ 1096.980278] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 740ecd60-f1c6-4713-b339-481a878486f1 with Priority: HIGHEST for action security_group_members [ 1096.980655] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-740ecd60-f1c6-4713-b339-481a878486f1 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.981137] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.981137] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.981603] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.981603] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.981721] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.981769] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.981981] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.982091] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.982215] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('740ecd60-f1c6-4713-b339-481a878486f1',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.081367] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d4ff60fe-3407-42aa-b33c-6254779ad495 in Status: SUCCESS [ 1097.081568] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d4ff60fe-3407-42aa-b33c-6254779ad495" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.347637] env[65337]: INFO networking_nsxv3.common.synchronization [req-82df8429-de1c-4668-a45e-761c7fc2b59a req-2765fd9f-e0a5-4820-b976-f6c4df1fb0da tempest-ServersTestMultiNic-1422308133 tempest-ServersTestMultiNic-1422308133-project-member] Enqueued Resource ID: 740ecd60-f1c6-4713-b339-481a878486f1 with Priority: HIGHEST for action security_group_members [ 1097.348328] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 740ecd60-f1c6-4713-b339-481a878486f1 with Priority: HIGHEST for action security_group_members [ 1097.348698] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-740ecd60-f1c6-4713-b339-481a878486f1 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.348855] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.485407] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.485641] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.485781] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.485938] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.486024] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.486248] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.486370] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.486448] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.486549] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.486656] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.486791] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 740ecd60-f1c6-4713-b339-481a878486f1 already deleted. [ 1097.486791] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.486932] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.487151] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.487305] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.487411] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.487483] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.487588] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.487672] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.487741] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('740ecd60-f1c6-4713-b339-481a878486f1',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.711089] env[65337]: INFO networking_nsxv3.common.synchronization [req-82df8429-de1c-4668-a45e-761c7fc2b59a req-98c8aa47-730e-48f4-bf6b-d93bfd172f73 tempest-ServersTestMultiNic-1422308133 tempest-ServersTestMultiNic-1422308133-project-member] Enqueued Resource ID: 740ecd60-f1c6-4713-b339-481a878486f1 with Priority: HIGHEST for action security_group_members [ 1097.711383] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 740ecd60-f1c6-4713-b339-481a878486f1 with Priority: HIGHEST for action security_group_members [ 1097.711727] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-740ecd60-f1c6-4713-b339-481a878486f1 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.711850] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.990730] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.991276] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.991276] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.991276] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.991276] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.991439] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.991536] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.991597] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.991742] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.991842] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.991902] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 740ecd60-f1c6-4713-b339-481a878486f1 already deleted. [ 1097.991975] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.992271] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.992345] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.992431] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.992532] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.992589] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.992721] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.992793] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.992882] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('740ecd60-f1c6-4713-b339-481a878486f1',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.104891] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock network-449 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.105334] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "network-449" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.105546] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "network-449" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.106043] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "network-449" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.106386] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.106763] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.106961] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.107284] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.107441] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.107659] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1098.107773] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1098.107881] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1098.107991] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1098.108150] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1098.108226] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1098.108354] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1098.132036] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1098.132036] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1098.132181] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1098.132303] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "network-449" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.133030] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock port-9e2959f2-d78f-4a99-81df-dd9d75e7886e taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.133030] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "port-9e2959f2-d78f-4a99-81df-dd9d75e7886e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.133030] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "port-9e2959f2-d78f-4a99-81df-dd9d75e7886e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.133249] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "port-9e2959f2-d78f-4a99-81df-dd9d75e7886e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.133391] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9e2959f2-d78f-4a99-81df-dd9d75e7886e',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.157080] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af1da677-d95a-4cec-95fa-b9208101b7dd in Status: SUCCESS [ 1098.157239] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.157395] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.157597] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.158135] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.158135] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.158135] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.158135] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.158653] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.158653] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('af1da677-d95a-4cec-95fa-b9208101b7dd',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.495686] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.496424] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.496424] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.496424] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.496424] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.496673] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.496673] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.496673] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.496838] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.496959] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.497038] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 740ecd60-f1c6-4713-b339-481a878486f1 already deleted. [ 1098.497094] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.637629] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.637836] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.637972] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.638300] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.638451] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.638606] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Segment Port 9e2959f2-d78f-4a99-81df-dd9d75e7886e not found, creating... [ 1098.638878] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.639056] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.639174] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.639395] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.639529] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.639806] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.640081] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.640222] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.640439] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.640574] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.640712] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Resource: SegmentPort with ID: 9e2959f2-d78f-4a99-81df-dd9d75e7886e is going to be created. [ 1098.661734] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.661927] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.662069] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.662353] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.662570] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.662812] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "port-9e2959f2-d78f-4a99-81df-dd9d75e7886e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.664349] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('af1da677-d95a-4cec-95fa-b9208101b7dd',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.166209] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('af1da677-d95a-4cec-95fa-b9208101b7dd',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.386672] env[65337]: INFO networking_nsxv3.common.synchronization [req-82df8429-de1c-4668-a45e-761c7fc2b59a req-44ab12aa-acce-4222-b86c-a86832bfffcf service nova] Enqueued Resource ID: 740ecd60-f1c6-4713-b339-481a878486f1 with Priority: HIGHEST for action security_group_rules [ 1099.386672] env[65337]: INFO networking_nsxv3.common.synchronization [req-82df8429-de1c-4668-a45e-761c7fc2b59a req-44ab12aa-acce-4222-b86c-a86832bfffcf service nova] Enqueued Resource ID: 740ecd60-f1c6-4713-b339-481a878486f1 with Priority: HIGHEST for action security_group_members [ 1099.386672] env[65337]: INFO networking_nsxv3.common.synchronization [req-82df8429-de1c-4668-a45e-761c7fc2b59a req-44ab12aa-acce-4222-b86c-a86832bfffcf service nova] Enqueued Resource ID: 9e2959f2-d78f-4a99-81df-dd9d75e7886e with Priority: HIGHEST for action port [ 1099.387360] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 740ecd60-f1c6-4713-b339-481a878486f1 with Priority: HIGHEST for action security_group_rules [ 1099.387645] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 740ecd60-f1c6-4713-b339-481a878486f1 with Priority: HIGHEST for action security_group_members [ 1099.387830] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e2959f2-d78f-4a99-81df-dd9d75e7886e with Priority: HIGHEST for action port [ 1099.388694] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-740ecd60-f1c6-4713-b339-481a878486f1 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.388963] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.389157] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.389480] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.389649] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('740ecd60-f1c6-4713-b339-481a878486f1',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.391628] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-740ecd60-f1c6-4713-b339-481a878486f1 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.391990] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.392165] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.397416] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.397416] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.397416] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.397416] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.397416] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.397416] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.397416] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('740ecd60-f1c6-4713-b339-481a878486f1',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.397416] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-9e2959f2-d78f-4a99-81df-dd9d75e7886e taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.397416] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9e2959f2-d78f-4a99-81df-dd9d75e7886e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.397983] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9e2959f2-d78f-4a99-81df-dd9d75e7886e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.398513] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9e2959f2-d78f-4a99-81df-dd9d75e7886e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.398748] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9e2959f2-d78f-4a99-81df-dd9d75e7886e',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.668807] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.669127] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.669252] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.669548] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.669660] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.669762] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: af1da677-d95a-4cec-95fa-b9208101b7dd is going to be updated. [ 1099.703862] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.704070] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.704136] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.704299] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.704442] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.715266] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af1da677-d95a-4cec-95fa-b9208101b7dd in Status: IN_PROGRESS for 2s [ 1099.901861] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('740ecd60-f1c6-4713-b339-481a878486f1',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.903014] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-740ecd60-f1c6-4713-b339-481a878486f1 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.903134] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.903357] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9e2959f2-d78f-4a99-81df-dd9d75e7886e with status ACTIVE [ 1099.903545] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.903654] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.903766] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.903983] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.904091] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.904246] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.904353] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.904412] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.904568] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.904655] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.904841] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.904962] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.905051] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.905685] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.905816] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.905996] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9e2959f2-d78f-4a99-81df-dd9d75e7886e is going to be updated. [ 1099.932472] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.932751] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.932751] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.933182] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.933182] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.933182] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9e2959f2-d78f-4a99-81df-dd9d75e7886e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.191282] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock network-989 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.191615] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "network-989" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.191615] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "network-989" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.191943] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "network-989" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.192227] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.192395] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.192520] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.192831] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.192990] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.193217] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1100.193329] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1100.193436] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1100.193543] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1100.193649] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1100.193778] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1100.193949] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1100.212861] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1100.213046] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1100.213174] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1100.213353] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "network-989" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.213667] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock port-326363b3-d48c-447b-b284-e09063376cea taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.213885] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "port-326363b3-d48c-447b-b284-e09063376cea" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.214024] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "port-326363b3-d48c-447b-b284-e09063376cea" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.214344] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "port-326363b3-d48c-447b-b284-e09063376cea" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.214482] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('326363b3-d48c-447b-b284-e09063376cea',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.408488] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('740ecd60-f1c6-4713-b339-481a878486f1',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.717299] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.717733] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.717984] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.718413] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.718651] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.718884] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Segment Port 326363b3-d48c-447b-b284-e09063376cea not found, creating... [ 1100.719324] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.719576] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.719768] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.720107] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.720437] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.720879] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.721140] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.721333] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.721649] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.721859] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.722090] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Resource: SegmentPort with ID: 326363b3-d48c-447b-b284-e09063376cea is going to be created. [ 1100.768971] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.769258] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.769365] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.769628] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.769883] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.770116] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "port-326363b3-d48c-447b-b284-e09063376cea" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.913161] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.913161] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.913161] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.913161] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.913161] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.913161] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 740ecd60-f1c6-4713-b339-481a878486f1 is going to be created. [ 1100.955241] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.955241] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.955241] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.955241] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.955241] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.968479] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 740ecd60-f1c6-4713-b339-481a878486f1 in Status: UNINITIALIZED for 2s [ 1101.486164] env[65337]: INFO networking_nsxv3.common.synchronization [req-82df8429-de1c-4668-a45e-761c7fc2b59a req-6d2676d5-7b12-4601-af74-80e9c8914085 service nova] Enqueued Resource ID: 740ecd60-f1c6-4713-b339-481a878486f1 with Priority: HIGHEST for action security_group_rules [ 1101.486410] env[65337]: INFO networking_nsxv3.common.synchronization [req-82df8429-de1c-4668-a45e-761c7fc2b59a req-6d2676d5-7b12-4601-af74-80e9c8914085 service nova] Enqueued Resource ID: 740ecd60-f1c6-4713-b339-481a878486f1 with Priority: HIGHEST for action security_group_members [ 1101.486551] env[65337]: INFO networking_nsxv3.common.synchronization [req-82df8429-de1c-4668-a45e-761c7fc2b59a req-6d2676d5-7b12-4601-af74-80e9c8914085 service nova] Enqueued Resource ID: 326363b3-d48c-447b-b284-e09063376cea with Priority: HIGHEST for action port [ 1101.487303] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 740ecd60-f1c6-4713-b339-481a878486f1 with Priority: HIGHEST for action security_group_rules [ 1101.487484] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 740ecd60-f1c6-4713-b339-481a878486f1 with Priority: HIGHEST for action security_group_members [ 1101.487601] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 326363b3-d48c-447b-b284-e09063376cea with Priority: HIGHEST for action port [ 1101.487970] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-740ecd60-f1c6-4713-b339-481a878486f1 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.488161] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.488433] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-740ecd60-f1c6-4713-b339-481a878486f1 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.488536] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.488801] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-326363b3-d48c-447b-b284-e09063376cea taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.489115] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-326363b3-d48c-447b-b284-e09063376cea" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.489178] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-326363b3-d48c-447b-b284-e09063376cea" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.489395] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-326363b3-d48c-447b-b284-e09063376cea" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.489496] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('326363b3-d48c-447b-b284-e09063376cea',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.727579] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af1da677-d95a-4cec-95fa-b9208101b7dd in Status: SUCCESS [ 1101.727871] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.728104] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.728409] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.728646] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.728782] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.728835] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.729031] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.729123] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.729220] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.729336] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('af1da677-d95a-4cec-95fa-b9208101b7dd',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.993460] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 326363b3-d48c-447b-b284-e09063376cea with status ACTIVE [ 1101.993778] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.993935] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.994017] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.994299] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.994395] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.994592] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.994705] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.994817] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.995088] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.995236] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.995457] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.995583] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.995650] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.995860] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.995993] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.996162] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 326363b3-d48c-447b-b284-e09063376cea is going to be updated. [ 1102.033075] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.033306] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.033306] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.033560] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.033750] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.033901] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-326363b3-d48c-447b-b284-e09063376cea" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.231992] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-af1da677-d95a-4cec-95fa-b9208101b7dd taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.232221] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.232287] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.232542] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.232735] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.232854] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.232926] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.233128] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.233220] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.233320] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.233482] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-af1da677-d95a-4cec-95fa-b9208101b7dd taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.233594] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.233659] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.233850] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.233976] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.234083] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.234166] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.234303] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.234380] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.234479] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.234574] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('af1da677-d95a-4cec-95fa-b9208101b7dd',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.303056] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock network-449 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.303056] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "network-449" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.303056] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "network-449" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.303551] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "network-449" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.303932] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.304228] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.304431] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.304771] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.305017] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.305339] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1102.305544] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1102.305737] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1102.305926] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1102.306149] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1102.306350] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1102.306581] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1102.329083] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1102.329259] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1102.329396] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1102.329570] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "network-449" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.329892] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock port-a25a6771-de37-4b4c-bb9b-48ec9acac3ee taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.330144] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "port-a25a6771-de37-4b4c-bb9b-48ec9acac3ee" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.330206] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "port-a25a6771-de37-4b4c-bb9b-48ec9acac3ee" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.330670] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "port-a25a6771-de37-4b4c-bb9b-48ec9acac3ee" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.330817] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a25a6771-de37-4b4c-bb9b-48ec9acac3ee',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.737607] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for af1da677-d95a-4cec-95fa-b9208101b7dd: rpc.has_security_group_logging(os_id): False [ 1102.761729] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.761909] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.762074] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.762300] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.762393] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.762613] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.762721] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.762795] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.763024] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.763105] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.763288] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.763384] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.763445] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.763582] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.763657] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.763878] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.763972] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.764039] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.764237] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.764328] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.764404] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: af1da677-d95a-4cec-95fa-b9208101b7dd is going to be updated. [ 1102.833894] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.833894] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.833894] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.833894] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.833894] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.834191] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.834798] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.834798] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.834798] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.834798] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.834798] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Segment Port a25a6771-de37-4b4c-bb9b-48ec9acac3ee not found, creating... [ 1102.834798] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.834798] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.834798] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.834798] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.834798] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.837510] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.837510] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.837510] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.837510] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.837510] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.837510] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Resource: SegmentPort with ID: a25a6771-de37-4b4c-bb9b-48ec9acac3ee is going to be created. [ 1102.856427] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: af1da677-d95a-4cec-95fa-b9208101b7dd in Status: IN_PROGRESS for 2s [ 1102.860420] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.860420] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.860623] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.860761] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.862061] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.862061] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "port-a25a6771-de37-4b4c-bb9b-48ec9acac3ee" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.981753] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 740ecd60-f1c6-4713-b339-481a878486f1 in Status: SUCCESS [ 1102.982054] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.983037] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.983037] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.983037] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.983037] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.983037] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.983037] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.983378] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.983378] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.983378] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('740ecd60-f1c6-4713-b339-481a878486f1',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.984332] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.984501] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.984668] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.984782] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.984840] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.984998] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.985093] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.985187] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('740ecd60-f1c6-4713-b339-481a878486f1',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.487495] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-740ecd60-f1c6-4713-b339-481a878486f1 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.487801] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.487886] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('740ecd60-f1c6-4713-b339-481a878486f1',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.600053] env[65337]: INFO networking_nsxv3.common.synchronization [req-82df8429-de1c-4668-a45e-761c7fc2b59a req-26287420-1005-42cf-a176-b728a5d71c83 service nova] Enqueued Resource ID: 740ecd60-f1c6-4713-b339-481a878486f1 with Priority: HIGHEST for action security_group_rules [ 1103.600310] env[65337]: INFO networking_nsxv3.common.synchronization [req-82df8429-de1c-4668-a45e-761c7fc2b59a req-26287420-1005-42cf-a176-b728a5d71c83 service nova] Enqueued Resource ID: 740ecd60-f1c6-4713-b339-481a878486f1 with Priority: HIGHEST for action security_group_members [ 1103.600373] env[65337]: INFO networking_nsxv3.common.synchronization [req-82df8429-de1c-4668-a45e-761c7fc2b59a req-26287420-1005-42cf-a176-b728a5d71c83 service nova] Enqueued Resource ID: a25a6771-de37-4b4c-bb9b-48ec9acac3ee with Priority: HIGHEST for action port [ 1103.601026] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 740ecd60-f1c6-4713-b339-481a878486f1 with Priority: HIGHEST for action security_group_rules [ 1103.601084] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 740ecd60-f1c6-4713-b339-481a878486f1 with Priority: HIGHEST for action security_group_members [ 1103.601121] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a25a6771-de37-4b4c-bb9b-48ec9acac3ee with Priority: HIGHEST for action port [ 1103.601403] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-740ecd60-f1c6-4713-b339-481a878486f1 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.601505] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.601692] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-740ecd60-f1c6-4713-b339-481a878486f1 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.601775] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.601945] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-a25a6771-de37-4b4c-bb9b-48ec9acac3ee taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.602069] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a25a6771-de37-4b4c-bb9b-48ec9acac3ee" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.602154] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a25a6771-de37-4b4c-bb9b-48ec9acac3ee" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.602405] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a25a6771-de37-4b4c-bb9b-48ec9acac3ee" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.602450] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a25a6771-de37-4b4c-bb9b-48ec9acac3ee',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.751443] env[65337]: INFO networking_nsxv3.common.synchronization [None req-247b975d-5bdd-4225-bae7-d25bbd803294 tempest-AttachInterfacesTestJSON-1783062477 tempest-AttachInterfacesTestJSON-1783062477-project-member] Enqueued Resource ID: 94a13e53-dcf7-4643-ade4-8789dc9eabc4 with Priority: HIGHEST for action security_group_members [ 1103.752290] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94a13e53-dcf7-4643-ade4-8789dc9eabc4 with Priority: HIGHEST for action security_group_members [ 1103.752376] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-94a13e53-dcf7-4643-ade4-8789dc9eabc4 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.752514] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.752599] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.752893] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.753119] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.754090] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.754090] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.754090] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.754090] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.754090] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('94a13e53-dcf7-4643-ade4-8789dc9eabc4',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.990368] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('740ecd60-f1c6-4713-b339-481a878486f1',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.106494] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a25a6771-de37-4b4c-bb9b-48ec9acac3ee with status ACTIVE [ 1104.106784] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.107019] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.107176] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.107344] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.107444] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.107662] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.107798] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.107883] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.108067] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.108155] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.108351] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.108446] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.108513] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.108669] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.108761] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.108903] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a25a6771-de37-4b4c-bb9b-48ec9acac3ee is going to be updated. [ 1104.136383] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.136383] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.136383] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.136383] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.136383] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.136383] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a25a6771-de37-4b4c-bb9b-48ec9acac3ee" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.256708] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.256967] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.257029] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.258337] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.258337] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.258337] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.258337] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.258337] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.258337] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.258337] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.258337] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 94a13e53-dcf7-4643-ade4-8789dc9eabc4 is going to be updated. [ 1104.329761] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.329761] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.329761] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.329761] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.330107] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.344782] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94a13e53-dcf7-4643-ade4-8789dc9eabc4 in Status: IN_PROGRESS for 2s [ 1104.493283] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.493283] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.493283] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.493521] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.493521] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.493665] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 740ecd60-f1c6-4713-b339-481a878486f1 is going to be updated. [ 1104.525489] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.525694] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.525756] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.525970] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.526171] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.536084] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 740ecd60-f1c6-4713-b339-481a878486f1 in Status: IN_PROGRESS for 2s [ 1104.876371] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: af1da677-d95a-4cec-95fa-b9208101b7dd in Status: SUCCESS [ 1104.876682] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.358357] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94a13e53-dcf7-4643-ade4-8789dc9eabc4 in Status: SUCCESS [ 1106.358357] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 94a13e53-dcf7-4643-ade4-8789dc9eabc4 deletion is rescheduled due to dependency. [ 1106.358357] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94a13e53-dcf7-4643-ade4-8789dc9eabc4" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.555683] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 740ecd60-f1c6-4713-b339-481a878486f1 in Status: SUCCESS [ 1106.555967] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.556186] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.556419] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.556722] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.556866] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.556946] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.557147] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.557263] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.557311] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.557486] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-740ecd60-f1c6-4713-b339-481a878486f1 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.557570] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.557630] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.557773] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.557917] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.558029] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.558092] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.558240] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.558326] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.558422] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.558514] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('740ecd60-f1c6-4713-b339-481a878486f1',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.559497] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.559792] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.559974] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.560127] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.560194] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.560378] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.561184] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.561298] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('740ecd60-f1c6-4713-b339-481a878486f1',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.063476] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 740ecd60-f1c6-4713-b339-481a878486f1: rpc.has_security_group_logging(os_id): False [ 1107.064707] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('740ecd60-f1c6-4713-b339-481a878486f1',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.084088] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.084392] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.084392] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.084573] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.084573] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.084771] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.084887] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.084963] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.085077] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.085154] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.085326] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.085430] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.085498] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.085595] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.085670] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.085891] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.086041] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.086041] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.086278] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.086438] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.086524] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 740ecd60-f1c6-4713-b339-481a878486f1 is going to be created. [ 1107.151135] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.151307] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.151347] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.151566] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.151711] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.167755] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 740ecd60-f1c6-4713-b339-481a878486f1 in Status: IN_PROGRESS for 2s [ 1107.567389] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('740ecd60-f1c6-4713-b339-481a878486f1',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.623142] env[65337]: INFO networking_nsxv3.common.synchronization [req-ec9eb718-974d-413b-bdc9-1b175147f3ac req-9c9a3ef2-ad92-4ed1-a8f1-6c0a7a8da2fd tempest-ServersTestJSON-1910122825 tempest-ServersTestJSON-1910122825-project-member] Enqueued Resource ID: af1da677-d95a-4cec-95fa-b9208101b7dd with Priority: HIGHEST for action security_group_members [ 1107.624167] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af1da677-d95a-4cec-95fa-b9208101b7dd with Priority: HIGHEST for action security_group_members [ 1107.624950] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-af1da677-d95a-4cec-95fa-b9208101b7dd taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.624950] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.624950] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.624950] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.625171] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.625322] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.625414] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.625599] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.625719] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.625870] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('af1da677-d95a-4cec-95fa-b9208101b7dd',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.070123] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.070608] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.070608] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.070608] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.070791] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.070791] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 740ecd60-f1c6-4713-b339-481a878486f1 is going to be updated. [ 1108.127942] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('af1da677-d95a-4cec-95fa-b9208101b7dd',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.133313] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.133492] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.133537] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.133805] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.133962] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.143960] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 740ecd60-f1c6-4713-b339-481a878486f1 in Status: IN_PROGRESS for 2s [ 1108.630078] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('af1da677-d95a-4cec-95fa-b9208101b7dd',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.793564] env[65337]: INFO networking_nsxv3.common.synchronization [None req-5208b222-dd09-466a-977d-fa84bf492eea None None] Enqueued Resource ID: 37e75021-3db8-47e6-833e-45987ea1fef8 with Priority: HIGHEST for action port [ 1108.794216] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37e75021-3db8-47e6-833e-45987ea1fef8 with Priority: HIGHEST for action port [ 1108.794531] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-37e75021-3db8-47e6-833e-45987ea1fef8 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.797360] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-37e75021-3db8-47e6-833e-45987ea1fef8" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.797360] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-37e75021-3db8-47e6-833e-45987ea1fef8" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.797360] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-37e75021-3db8-47e6-833e-45987ea1fef8" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.797360] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('37e75021-3db8-47e6-833e-45987ea1fef8',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.134898] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.134898] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.134898] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.134898] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.134898] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.134898] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: af1da677-d95a-4cec-95fa-b9208101b7dd is going to be updated. [ 1109.168800] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.169043] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.169127] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.169350] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.169500] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.180641] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af1da677-d95a-4cec-95fa-b9208101b7dd in Status: IN_PROGRESS for 2s [ 1109.181814] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 740ecd60-f1c6-4713-b339-481a878486f1 in Status: SUCCESS [ 1109.182073] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.182246] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.182458] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.182547] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('740ecd60-f1c6-4713-b339-481a878486f1',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.298848] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 37e75021-3db8-47e6-833e-45987ea1fef8 [ 1109.299815] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.299815] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.299815] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.299815] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.299815] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.299815] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:37e75021-3db8-47e6-833e-45987ea1fef8 already deleted. [ 1109.299815] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-37e75021-3db8-47e6-833e-45987ea1fef8" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.488012] env[65337]: INFO networking_nsxv3.common.synchronization [None req-5e11791a-8b97-4e8a-a8d0-3aec74fa743a tempest-ServersTestFqdnHostnames-2010354875 tempest-ServersTestFqdnHostnames-2010354875-project-member] Enqueued Resource ID: c006a909-f4e1-43d8-bc34-4038d7937297 with Priority: HIGHEST for action security_group_rules [ 1109.488579] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c006a909-f4e1-43d8-bc34-4038d7937297 with Priority: HIGHEST for action security_group_rules [ 1109.488972] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c006a909-f4e1-43d8-bc34-4038d7937297 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.489351] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c006a909-f4e1-43d8-bc34-4038d7937297" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.489351] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c006a909-f4e1-43d8-bc34-4038d7937297" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.490179] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c006a909-f4e1-43d8-bc34-4038d7937297" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.490179] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c006a909-f4e1-43d8-bc34-4038d7937297',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.581893] env[65337]: INFO networking_nsxv3.common.synchronization [None req-ac779ae2-bb28-4822-bcd0-003c8b4d3f7c tempest-ServersTestFqdnHostnames-2010354875 tempest-ServersTestFqdnHostnames-2010354875-project-member] Enqueued Resource ID: c006a909-f4e1-43d8-bc34-4038d7937297 with Priority: HIGHEST for action security_group_rules [ 1109.582216] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c006a909-f4e1-43d8-bc34-4038d7937297 with Priority: HIGHEST for action security_group_rules [ 1109.582435] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c006a909-f4e1-43d8-bc34-4038d7937297 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.582530] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c006a909-f4e1-43d8-bc34-4038d7937297" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.685116] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-740ecd60-f1c6-4713-b339-481a878486f1 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.685454] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.016769] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.016769] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.016769] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.016769] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.016769] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.016769] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c006a909-f4e1-43d8-bc34-4038d7937297 already deleted. [ 1110.016769] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c006a909-f4e1-43d8-bc34-4038d7937297" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.016769] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c006a909-f4e1-43d8-bc34-4038d7937297" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.016769] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c006a909-f4e1-43d8-bc34-4038d7937297" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.016769] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c006a909-f4e1-43d8-bc34-4038d7937297',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.160724] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 740ecd60-f1c6-4713-b339-481a878486f1 in Status: SUCCESS [ 1110.160724] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.160724] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.160724] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.160724] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.160724] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.160724] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.160724] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.160724] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.161962] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.161962] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('740ecd60-f1c6-4713-b339-481a878486f1',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.539334] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.539334] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.539334] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.539334] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.539334] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.539334] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c006a909-f4e1-43d8-bc34-4038d7937297 already deleted. [ 1110.539334] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c006a909-f4e1-43d8-bc34-4038d7937297" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.664430] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-740ecd60-f1c6-4713-b339-481a878486f1 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.664613] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.664613] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.664818] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.665077] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.665229] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.665229] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.665605] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.665605] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.665605] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.665696] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-740ecd60-f1c6-4713-b339-481a878486f1 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.665789] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.665939] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.666135] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.666336] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.666573] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.666573] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.666769] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.668260] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.668429] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.668489] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('740ecd60-f1c6-4713-b339-481a878486f1',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.172869] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 740ecd60-f1c6-4713-b339-481a878486f1: rpc.has_security_group_logging(os_id): False [ 1111.194350] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af1da677-d95a-4cec-95fa-b9208101b7dd in Status: IN_PROGRESS for 4s [ 1111.195938] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.196116] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.196185] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.196527] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.196527] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.196724] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.196837] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.196901] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.197102] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.197186] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.197379] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.197474] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.197535] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.197673] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.197747] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.197937] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.198112] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.198165] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.198278] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.198352] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.198435] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 740ecd60-f1c6-4713-b339-481a878486f1 is going to be updated. [ 1111.204310] env[65337]: INFO networking_nsxv3.common.synchronization [None req-1b06a02e-81fc-4979-a938-f1258ca282ec None None] Enqueued Resource ID: 9cdb5fa2-7a7d-4387-8ed9-408b6da74ba0 with Priority: HIGHEST for action port [ 1111.205634] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cdb5fa2-7a7d-4387-8ed9-408b6da74ba0 with Priority: HIGHEST for action port [ 1111.205634] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-9cdb5fa2-7a7d-4387-8ed9-408b6da74ba0 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.205634] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9cdb5fa2-7a7d-4387-8ed9-408b6da74ba0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.205634] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9cdb5fa2-7a7d-4387-8ed9-408b6da74ba0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.205899] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9cdb5fa2-7a7d-4387-8ed9-408b6da74ba0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.205899] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9cdb5fa2-7a7d-4387-8ed9-408b6da74ba0',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.311655] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.311655] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.311655] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.311927] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.311927] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.334692] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 740ecd60-f1c6-4713-b339-481a878486f1 in Status: IN_PROGRESS for 2s [ 1111.708458] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9cdb5fa2-7a7d-4387-8ed9-408b6da74ba0 [ 1111.708669] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.708798] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.708868] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.709118] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.709212] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.709332] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9cdb5fa2-7a7d-4387-8ed9-408b6da74ba0 already deleted. [ 1111.709385] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9cdb5fa2-7a7d-4387-8ed9-408b6da74ba0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.397552] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock network-981 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.397897] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "network-981" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.397897] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "network-981" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.398238] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "network-981" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.398495] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.398756] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.398863] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.399125] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.399273] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.399480] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1112.399592] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1112.399698] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1112.399818] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1112.400568] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1112.400568] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1112.400568] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1112.426374] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1112.426374] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1112.426685] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1112.426739] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "network-981" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.427638] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock port-537ead43-a9bc-428f-8a1e-44c7dfff2558 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.427638] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "port-537ead43-a9bc-428f-8a1e-44c7dfff2558" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.427638] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "port-537ead43-a9bc-428f-8a1e-44c7dfff2558" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.427638] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "port-537ead43-a9bc-428f-8a1e-44c7dfff2558" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.427873] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('537ead43-a9bc-428f-8a1e-44c7dfff2558',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.932180] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.932433] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.932611] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.932900] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.933041] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.933438] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.933601] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.933721] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.933956] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.934106] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.934393] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.934578] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.934705] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.935050] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.935614] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.935803] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Resource: SegmentPort with ID: 537ead43-a9bc-428f-8a1e-44c7dfff2558 is going to be updated. [ 1112.972105] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.972376] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.972515] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.972806] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.973108] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.973333] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "port-537ead43-a9bc-428f-8a1e-44c7dfff2558" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.205691] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af1da677-d95a-4cec-95fa-b9208101b7dd in Status: SUCCESS [ 1113.205937] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.353168] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 740ecd60-f1c6-4713-b339-481a878486f1 in Status: SUCCESS [ 1113.353461] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.353711] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.354118] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.354250] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('740ecd60-f1c6-4713-b339-481a878486f1',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.693108] env[65337]: INFO networking_nsxv3.common.synchronization [req-4d9b9f8f-1861-4455-bc17-e9e78cf8f346 req-2d8aa66d-63a0-4dcf-bdf2-303a459bcf8b service nova] Enqueued Resource ID: 7b634dce-1340-436a-a5af-e7d03954de92 with Priority: HIGHEST for action security_group_rules [ 1113.693108] env[65337]: INFO networking_nsxv3.common.synchronization [req-4d9b9f8f-1861-4455-bc17-e9e78cf8f346 req-2d8aa66d-63a0-4dcf-bdf2-303a459bcf8b service nova] Enqueued Resource ID: 7b634dce-1340-436a-a5af-e7d03954de92 with Priority: HIGHEST for action security_group_members [ 1113.693430] env[65337]: INFO networking_nsxv3.common.synchronization [req-4d9b9f8f-1861-4455-bc17-e9e78cf8f346 req-2d8aa66d-63a0-4dcf-bdf2-303a459bcf8b service nova] Enqueued Resource ID: 537ead43-a9bc-428f-8a1e-44c7dfff2558 with Priority: HIGHEST for action port [ 1113.693913] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b634dce-1340-436a-a5af-e7d03954de92 with Priority: HIGHEST for action security_group_rules [ 1113.693913] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b634dce-1340-436a-a5af-e7d03954de92 with Priority: HIGHEST for action security_group_members [ 1113.694097] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 537ead43-a9bc-428f-8a1e-44c7dfff2558 with Priority: HIGHEST for action port [ 1113.695089] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7b634dce-1340-436a-a5af-e7d03954de92 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.695225] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7b634dce-1340-436a-a5af-e7d03954de92" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.695292] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7b634dce-1340-436a-a5af-e7d03954de92" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.695491] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7b634dce-1340-436a-a5af-e7d03954de92" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.695573] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7b634dce-1340-436a-a5af-e7d03954de92',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.696549] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b634dce-1340-436a-a5af-e7d03954de92 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.696669] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b634dce-1340-436a-a5af-e7d03954de92" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.696807] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b634dce-1340-436a-a5af-e7d03954de92" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.696929] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b634dce-1340-436a-a5af-e7d03954de92" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.697128] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.697412] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.697412] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.697607] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.697607] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.697607] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7b634dce-1340-436a-a5af-e7d03954de92',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.698413] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-537ead43-a9bc-428f-8a1e-44c7dfff2558 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.698540] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-537ead43-a9bc-428f-8a1e-44c7dfff2558" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.698602] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-537ead43-a9bc-428f-8a1e-44c7dfff2558" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.698720] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-537ead43-a9bc-428f-8a1e-44c7dfff2558" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.698792] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('537ead43-a9bc-428f-8a1e-44c7dfff2558',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.856910] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-740ecd60-f1c6-4713-b339-481a878486f1 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.857166] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.857305] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.857645] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.857934] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.858145] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.858233] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.858427] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.858581] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.858763] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.858920] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('740ecd60-f1c6-4713-b339-481a878486f1',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.201108] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b634dce-1340-436a-a5af-e7d03954de92 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.201352] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b634dce-1340-436a-a5af-e7d03954de92" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.201451] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7b634dce-1340-436a-a5af-e7d03954de92',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.202670] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 537ead43-a9bc-428f-8a1e-44c7dfff2558 with status ACTIVE [ 1114.202670] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.202949] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.202949] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.204074] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.204074] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.204074] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.204074] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.204074] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.204074] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.204074] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.204489] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.204489] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.204489] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.204489] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.204489] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.204726] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 537ead43-a9bc-428f-8a1e-44c7dfff2558 is going to be updated. [ 1114.230821] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.231122] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.231200] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.231421] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.231581] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.231820] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-537ead43-a9bc-428f-8a1e-44c7dfff2558" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.361774] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-740ecd60-f1c6-4713-b339-481a878486f1 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.362063] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.362063] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.362218] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.362421] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.362522] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.362614] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.362741] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.362840] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.362931] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.363082] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-740ecd60-f1c6-4713-b339-481a878486f1 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.363201] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.363269] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.363406] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.363549] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.363641] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.363712] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.363938] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.364057] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.364116] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.364194] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('740ecd60-f1c6-4713-b339-481a878486f1',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.706934] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7b634dce-1340-436a-a5af-e7d03954de92',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.867853] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 740ecd60-f1c6-4713-b339-481a878486f1: rpc.has_security_group_logging(os_id): False [ 1114.888713] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.888935] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.889055] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.889324] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.889455] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.889767] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.889894] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.889995] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.890193] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.890296] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.890536] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.890639] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.890698] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.890886] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.890969] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.891233] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.891340] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.891474] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.891566] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.891640] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.891754] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 740ecd60-f1c6-4713-b339-481a878486f1 is going to be updated. [ 1114.996939] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.996939] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.996939] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.996939] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.996939] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.011607] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 740ecd60-f1c6-4713-b339-481a878486f1 in Status: IN_PROGRESS for 2s [ 1115.210467] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.210636] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.210715] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.210937] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.211072] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.211128] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b634dce-1340-436a-a5af-e7d03954de92 is going to be updated. [ 1115.251694] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.251897] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.251998] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.252257] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.252418] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.261700] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b634dce-1340-436a-a5af-e7d03954de92 in Status: IN_PROGRESS for 2s [ 1115.343168] env[65337]: INFO networking_nsxv3.common.synchronization [req-e6b8dc5c-4f04-4fb5-9fb9-294de12dc6a6 req-5c993ccf-f30f-4e14-8832-cf3f5b6e26e0 tempest-ServersTestMultiNic-1422308133 tempest-ServersTestMultiNic-1422308133-project-member] Enqueued Resource ID: 740ecd60-f1c6-4713-b339-481a878486f1 with Priority: HIGHEST for action security_group_members [ 1115.344230] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 740ecd60-f1c6-4713-b339-481a878486f1 with Priority: HIGHEST for action security_group_members [ 1115.344831] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-740ecd60-f1c6-4713-b339-481a878486f1 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.344831] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.344831] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.345051] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.345051] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.345172] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.345172] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.345363] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.345363] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.345456] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('740ecd60-f1c6-4713-b339-481a878486f1',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.570329] env[65337]: INFO networking_nsxv3.common.synchronization [req-e6b8dc5c-4f04-4fb5-9fb9-294de12dc6a6 req-4ddc7a9b-1d82-4c3a-89e3-fd05c74f9dee tempest-ServersTestMultiNic-1422308133 tempest-ServersTestMultiNic-1422308133-project-member] Enqueued Resource ID: 740ecd60-f1c6-4713-b339-481a878486f1 with Priority: HIGHEST for action security_group_members [ 1115.571016] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 740ecd60-f1c6-4713-b339-481a878486f1 with Priority: HIGHEST for action security_group_members [ 1115.571630] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-740ecd60-f1c6-4713-b339-481a878486f1 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.571630] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.765537] env[65337]: INFO networking_nsxv3.common.synchronization [req-e6b8dc5c-4f04-4fb5-9fb9-294de12dc6a6 req-2e6b3ef0-b859-4123-86f1-88c15574881a tempest-ServersTestMultiNic-1422308133 tempest-ServersTestMultiNic-1422308133-project-member] Enqueued Resource ID: 740ecd60-f1c6-4713-b339-481a878486f1 with Priority: HIGHEST for action security_group_members [ 1115.766140] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 740ecd60-f1c6-4713-b339-481a878486f1 with Priority: HIGHEST for action security_group_members [ 1115.766457] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-740ecd60-f1c6-4713-b339-481a878486f1 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.766560] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.847624] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('740ecd60-f1c6-4713-b339-481a878486f1',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.350478] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('740ecd60-f1c6-4713-b339-481a878486f1',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.853067] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.853286] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.853286] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.853524] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.853613] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.853705] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 740ecd60-f1c6-4713-b339-481a878486f1 is going to be updated. [ 1116.892378] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.892538] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.892579] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.892785] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.892938] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.921195] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 740ecd60-f1c6-4713-b339-481a878486f1 in Status: IN_PROGRESS for 2s [ 1117.029238] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 740ecd60-f1c6-4713-b339-481a878486f1 in Status: SUCCESS [ 1117.029591] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.177703] env[65337]: INFO networking_nsxv3.common.synchronization [req-e680c3cb-6f78-4851-a637-1e39e65f9b5e req-4e90f564-d816-48b8-84bc-c2f4dfa9c4cd tempest-ServerActionsTestOtherA-84911055 tempest-ServerActionsTestOtherA-84911055-project-member] Enqueued Resource ID: a4a9546d-8cbc-404d-acef-d7856f353fbe with Priority: HIGHEST for action security_group_members [ 1117.178405] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4a9546d-8cbc-404d-acef-d7856f353fbe with Priority: HIGHEST for action security_group_members [ 1117.178652] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4a9546d-8cbc-404d-acef-d7856f353fbe taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.178769] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4a9546d-8cbc-404d-acef-d7856f353fbe" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.178887] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4a9546d-8cbc-404d-acef-d7856f353fbe" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.179321] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4a9546d-8cbc-404d-acef-d7856f353fbe" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.179530] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.179606] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.179639] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.179804] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.179891] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.179986] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a4a9546d-8cbc-404d-acef-d7856f353fbe',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.272377] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b634dce-1340-436a-a5af-e7d03954de92 in Status: SUCCESS [ 1117.272560] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b634dce-1340-436a-a5af-e7d03954de92" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.272740] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b634dce-1340-436a-a5af-e7d03954de92" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.272964] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b634dce-1340-436a-a5af-e7d03954de92" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.273187] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.273315] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.273410] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.273650] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.273756] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.273926] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b634dce-1340-436a-a5af-e7d03954de92" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.274059] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7b634dce-1340-436a-a5af-e7d03954de92',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.561826] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock network-393 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.561826] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "network-393" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.561942] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "network-393" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.562747] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "network-393" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.562747] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.562747] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.562747] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.562991] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.563045] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.563254] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1117.563352] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1117.563457] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1117.563561] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1117.563669] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1117.563772] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1117.563945] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1117.583890] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1117.584436] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1117.584436] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1117.584436] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "network-393" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.584674] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock port-02c049fe-c5d8-4ed7-9fc3-89ed27c449d9 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.584837] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "port-02c049fe-c5d8-4ed7-9fc3-89ed27c449d9" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.584955] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "port-02c049fe-c5d8-4ed7-9fc3-89ed27c449d9" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.585313] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "port-02c049fe-c5d8-4ed7-9fc3-89ed27c449d9" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.585454] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('02c049fe-c5d8-4ed7-9fc3-89ed27c449d9',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.683050] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a4a9546d-8cbc-404d-acef-d7856f353fbe',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.776297] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7b634dce-1340-436a-a5af-e7d03954de92',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.089610] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.089610] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.089610] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.089610] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.089610] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.089610] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Segment Port 02c049fe-c5d8-4ed7-9fc3-89ed27c449d9 not found, creating... [ 1118.090133] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.090133] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.090133] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.091261] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.091261] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.091261] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.091261] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.091261] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.091487] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.091641] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.091708] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Resource: SegmentPort with ID: 02c049fe-c5d8-4ed7-9fc3-89ed27c449d9 is going to be created. [ 1118.117338] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.118704] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.118704] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.118704] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.118704] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.118704] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "port-02c049fe-c5d8-4ed7-9fc3-89ed27c449d9" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.186811] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a4a9546d-8cbc-404d-acef-d7856f353fbe',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.279311] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7b634dce-1340-436a-a5af-e7d03954de92: rpc.has_security_group_logging(os_id): False [ 1118.314643] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.314800] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.314880] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.315147] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.315249] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.315548] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.315667] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.315732] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.315983] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.316126] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.316202] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7b634dce-1340-436a-a5af-e7d03954de92 is going to be updated. [ 1118.392734] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.393367] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.393451] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.393677] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.393832] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.411641] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7b634dce-1340-436a-a5af-e7d03954de92 in Status: IN_PROGRESS for 2s [ 1118.690118] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.690118] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.690396] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.690460] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.690581] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.690724] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4a9546d-8cbc-404d-acef-d7856f353fbe is going to be updated. [ 1118.728126] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.728311] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.728410] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.728640] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.728815] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.739828] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4a9546d-8cbc-404d-acef-d7856f353fbe in Status: IN_PROGRESS for 2s [ 1118.853691] env[65337]: INFO networking_nsxv3.common.synchronization [req-e680c3cb-6f78-4851-a637-1e39e65f9b5e req-13fe198c-1b4d-4fa3-ba5f-f2b46dd66f37 service nova] Enqueued Resource ID: a4a9546d-8cbc-404d-acef-d7856f353fbe with Priority: HIGHEST for action security_group_rules [ 1118.853761] env[65337]: INFO networking_nsxv3.common.synchronization [req-e680c3cb-6f78-4851-a637-1e39e65f9b5e req-13fe198c-1b4d-4fa3-ba5f-f2b46dd66f37 service nova] Enqueued Resource ID: a4a9546d-8cbc-404d-acef-d7856f353fbe with Priority: HIGHEST for action security_group_members [ 1118.854047] env[65337]: INFO networking_nsxv3.common.synchronization [req-e680c3cb-6f78-4851-a637-1e39e65f9b5e req-13fe198c-1b4d-4fa3-ba5f-f2b46dd66f37 service nova] Enqueued Resource ID: 02c049fe-c5d8-4ed7-9fc3-89ed27c449d9 with Priority: HIGHEST for action port [ 1118.856313] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4a9546d-8cbc-404d-acef-d7856f353fbe with Priority: HIGHEST for action security_group_rules [ 1118.856491] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4a9546d-8cbc-404d-acef-d7856f353fbe with Priority: HIGHEST for action security_group_members [ 1118.856630] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02c049fe-c5d8-4ed7-9fc3-89ed27c449d9 with Priority: HIGHEST for action port [ 1118.857015] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a4a9546d-8cbc-404d-acef-d7856f353fbe taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.857153] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a4a9546d-8cbc-404d-acef-d7856f353fbe" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.857234] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a4a9546d-8cbc-404d-acef-d7856f353fbe" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.857427] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a4a9546d-8cbc-404d-acef-d7856f353fbe" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.857510] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a4a9546d-8cbc-404d-acef-d7856f353fbe',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.858640] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4a9546d-8cbc-404d-acef-d7856f353fbe taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.858640] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4a9546d-8cbc-404d-acef-d7856f353fbe" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.858858] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-02c049fe-c5d8-4ed7-9fc3-89ed27c449d9 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.858939] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-02c049fe-c5d8-4ed7-9fc3-89ed27c449d9" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.859011] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-02c049fe-c5d8-4ed7-9fc3-89ed27c449d9" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.859197] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-02c049fe-c5d8-4ed7-9fc3-89ed27c449d9" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.859352] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('02c049fe-c5d8-4ed7-9fc3-89ed27c449d9',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.933747] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 740ecd60-f1c6-4713-b339-481a878486f1 in Status: SUCCESS [ 1118.934092] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.934306] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.934607] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.934858] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.935043] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.935145] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.935359] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.935675] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.935675] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('740ecd60-f1c6-4713-b339-481a878486f1',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.362024] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4a9546d-8cbc-404d-acef-d7856f353fbe taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.362024] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4a9546d-8cbc-404d-acef-d7856f353fbe" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.362024] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 02c049fe-c5d8-4ed7-9fc3-89ed27c449d9 with status ACTIVE [ 1119.362024] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.362024] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.362024] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.362738] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.362738] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.362738] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.362738] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.362738] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.362900] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.362900] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.363066] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.363159] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.363217] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.363362] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.363439] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.363534] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 02c049fe-c5d8-4ed7-9fc3-89ed27c449d9 is going to be updated. [ 1119.391887] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.391887] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.391887] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.391887] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.391887] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.391887] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-02c049fe-c5d8-4ed7-9fc3-89ed27c449d9" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.438333] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.438528] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.438528] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.438703] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.438792] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.438990] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.439118] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.439177] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.439342] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.439420] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.439505] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 740ecd60-f1c6-4713-b339-481a878486f1 is going to be updated. [ 1119.488056] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.488284] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.488412] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.488547] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.488688] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.503727] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 740ecd60-f1c6-4713-b339-481a878486f1 in Status: IN_PROGRESS for 2s [ 1119.524468] env[65337]: INFO networking_nsxv3.common.synchronization [req-f2407b64-5987-4ea7-ac29-3ccb8aa1f6d7 req-5094c95b-36db-4c4f-9ff2-1cc9aa771772 tempest-ServersTestFqdnHostnames-2010354875 tempest-ServersTestFqdnHostnames-2010354875-project-member] Enqueued Resource ID: c006a909-f4e1-43d8-bc34-4038d7937297 with Priority: HIGHEST for action security_group_members [ 1119.525039] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c006a909-f4e1-43d8-bc34-4038d7937297 with Priority: HIGHEST for action security_group_members [ 1119.525360] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-c006a909-f4e1-43d8-bc34-4038d7937297 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.525481] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c006a909-f4e1-43d8-bc34-4038d7937297" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.525549] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c006a909-f4e1-43d8-bc34-4038d7937297" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.525842] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c006a909-f4e1-43d8-bc34-4038d7937297" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.526048] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.526155] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.526219] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.526375] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.526460] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.526555] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c006a909-f4e1-43d8-bc34-4038d7937297',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.894658] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock network-700 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.895012] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "network-700" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.895286] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "network-700" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.895852] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "network-700" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.896361] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.896649] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.896837] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.897229] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.897456] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.897776] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1119.897949] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1119.898145] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1119.898310] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1119.898492] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1119.898675] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1119.898862] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1119.948468] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1119.948655] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Cache value generated in 0.050 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1119.948792] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1119.949058] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "network-700" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.949415] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock port-96da36fb-843a-4a87-87b4-37be2f93e783 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.949656] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "port-96da36fb-843a-4a87-87b4-37be2f93e783" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.949718] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "port-96da36fb-843a-4a87-87b4-37be2f93e783" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.950140] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "port-96da36fb-843a-4a87-87b4-37be2f93e783" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.950307] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('96da36fb-843a-4a87-87b4-37be2f93e783',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.030082] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.030276] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.030337] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.030569] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.030693] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.030959] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.031108] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.031108] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.031264] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.031417] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.031417] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c006a909-f4e1-43d8-bc34-4038d7937297 already deleted. [ 1120.031495] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c006a909-f4e1-43d8-bc34-4038d7937297" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.429317] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7b634dce-1340-436a-a5af-e7d03954de92 in Status: SUCCESS [ 1120.429732] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7b634dce-1340-436a-a5af-e7d03954de92" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.452633] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.452854] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.452970] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.453336] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.453499] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.453660] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Segment Port 96da36fb-843a-4a87-87b4-37be2f93e783 not found, creating... [ 1120.453988] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.454216] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.454358] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.454631] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.454773] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.455218] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.455461] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.455634] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.455990] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.456226] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.456423] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Resource: SegmentPort with ID: 96da36fb-843a-4a87-87b4-37be2f93e783 is going to be created. [ 1120.478843] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.479128] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.479240] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.479494] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.479723] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.479944] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "port-96da36fb-843a-4a87-87b4-37be2f93e783" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.751263] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4a9546d-8cbc-404d-acef-d7856f353fbe in Status: SUCCESS [ 1120.751494] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4a9546d-8cbc-404d-acef-d7856f353fbe" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.751666] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4a9546d-8cbc-404d-acef-d7856f353fbe" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.751894] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4a9546d-8cbc-404d-acef-d7856f353fbe" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.752205] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.752317] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.752357] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.752550] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.752671] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.752778] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a4a9546d-8cbc-404d-acef-d7856f353fbe',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.179329] env[65337]: INFO networking_nsxv3.common.synchronization [req-f2407b64-5987-4ea7-ac29-3ccb8aa1f6d7 req-bc937184-c332-4bee-a27e-fa79bd372b76 service nova] Enqueued Resource ID: c006a909-f4e1-43d8-bc34-4038d7937297 with Priority: HIGHEST for action security_group_rules [ 1121.179508] env[65337]: INFO networking_nsxv3.common.synchronization [req-f2407b64-5987-4ea7-ac29-3ccb8aa1f6d7 req-bc937184-c332-4bee-a27e-fa79bd372b76 service nova] Enqueued Resource ID: c006a909-f4e1-43d8-bc34-4038d7937297 with Priority: HIGHEST for action security_group_members [ 1121.179629] env[65337]: INFO networking_nsxv3.common.synchronization [req-f2407b64-5987-4ea7-ac29-3ccb8aa1f6d7 req-bc937184-c332-4bee-a27e-fa79bd372b76 service nova] Enqueued Resource ID: 96da36fb-843a-4a87-87b4-37be2f93e783 with Priority: HIGHEST for action port [ 1121.180218] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c006a909-f4e1-43d8-bc34-4038d7937297 with Priority: HIGHEST for action security_group_rules [ 1121.180378] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c006a909-f4e1-43d8-bc34-4038d7937297 with Priority: HIGHEST for action security_group_members [ 1121.180478] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96da36fb-843a-4a87-87b4-37be2f93e783 with Priority: HIGHEST for action port [ 1121.180764] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c006a909-f4e1-43d8-bc34-4038d7937297 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.180883] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c006a909-f4e1-43d8-bc34-4038d7937297" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.180950] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c006a909-f4e1-43d8-bc34-4038d7937297" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.181180] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c006a909-f4e1-43d8-bc34-4038d7937297" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.182281] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c006a909-f4e1-43d8-bc34-4038d7937297',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.182281] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-c006a909-f4e1-43d8-bc34-4038d7937297 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.182515] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c006a909-f4e1-43d8-bc34-4038d7937297" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.182515] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c006a909-f4e1-43d8-bc34-4038d7937297" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.182627] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c006a909-f4e1-43d8-bc34-4038d7937297" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.182679] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.182771] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.182834] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.182972] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.183062] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.183149] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c006a909-f4e1-43d8-bc34-4038d7937297',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.184344] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-96da36fb-843a-4a87-87b4-37be2f93e783 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.184586] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-96da36fb-843a-4a87-87b4-37be2f93e783" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.184766] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-96da36fb-843a-4a87-87b4-37be2f93e783" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.184950] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-96da36fb-843a-4a87-87b4-37be2f93e783" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.185310] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('96da36fb-843a-4a87-87b4-37be2f93e783',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.254861] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a4a9546d-8cbc-404d-acef-d7856f353fbe',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.516482] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 740ecd60-f1c6-4713-b339-481a878486f1 in Status: SUCCESS [ 1121.516832] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 740ecd60-f1c6-4713-b339-481a878486f1 deletion is rescheduled due to dependency. [ 1121.516832] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.517039] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.517185] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.517448] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.517628] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.517741] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.517918] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.517995] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.518121] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('740ecd60-f1c6-4713-b339-481a878486f1',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.687269] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-c006a909-f4e1-43d8-bc34-4038d7937297 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.687921] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c006a909-f4e1-43d8-bc34-4038d7937297" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.688740] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c006a909-f4e1-43d8-bc34-4038d7937297',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.689806] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 96da36fb-843a-4a87-87b4-37be2f93e783 with status ACTIVE [ 1121.689979] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.690094] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.690176] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.690459] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.690558] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.690811] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.690930] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.690990] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.691149] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.691222] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.691470] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.691579] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.691622] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.691860] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.691860] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.692014] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 96da36fb-843a-4a87-87b4-37be2f93e783 is going to be updated. [ 1121.741692] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.741959] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.742137] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.742374] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.742560] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.742797] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-96da36fb-843a-4a87-87b4-37be2f93e783" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.757301] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a4a9546d-8cbc-404d-acef-d7856f353fbe',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.920425] env[65337]: INFO networking_nsxv3.common.synchronization [req-12d148b8-027f-42a0-98fc-8b069fc8badd req-504cdb98-6db1-4c46-88b3-190625baebe7 tempest-ServersTestJSON-1910122825 tempest-ServersTestJSON-1910122825-project-member] Enqueued Resource ID: af1da677-d95a-4cec-95fa-b9208101b7dd with Priority: HIGHEST for action security_group_members [ 1121.921450] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af1da677-d95a-4cec-95fa-b9208101b7dd with Priority: HIGHEST for action security_group_members [ 1121.921913] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-af1da677-d95a-4cec-95fa-b9208101b7dd taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.922124] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.922274] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.922509] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.922737] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.922871] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.922968] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.923200] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.923336] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.924358] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('af1da677-d95a-4cec-95fa-b9208101b7dd',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.023317] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.023502] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.023545] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.023754] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.023898] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.025119] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.025119] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.025119] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.025119] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.025119] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.025119] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 740ecd60-f1c6-4713-b339-481a878486f1 is going to be updated. [ 1122.056255] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.056477] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.056590] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.056860] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.057126] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.067771] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 740ecd60-f1c6-4713-b339-481a878486f1 in Status: IN_PROGRESS for 2s [ 1122.194937] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c006a909-f4e1-43d8-bc34-4038d7937297',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.260263] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.260263] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.260263] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.260605] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.260728] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.260836] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4a9546d-8cbc-404d-acef-d7856f353fbe is going to be updated. [ 1122.271242] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock network-48 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.271441] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "network-48" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.271553] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "network-48" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.271832] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "network-48" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.272199] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.272393] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.272515] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.272735] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.272877] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.273109] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1122.273225] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1122.273334] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1122.273440] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1122.273549] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1122.273653] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1122.273784] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1122.300375] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1122.300558] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1122.300702] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1122.300880] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "network-48" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.301243] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock port-aa57a5e7-0c57-4eea-9d00-7a44f0a62824 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.301425] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "port-aa57a5e7-0c57-4eea-9d00-7a44f0a62824" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.301546] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "port-aa57a5e7-0c57-4eea-9d00-7a44f0a62824" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.301879] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "port-aa57a5e7-0c57-4eea-9d00-7a44f0a62824" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.302031] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aa57a5e7-0c57-4eea-9d00-7a44f0a62824',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.329384] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.329591] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.329683] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.329929] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.330153] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.342716] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4a9546d-8cbc-404d-acef-d7856f353fbe in Status: IN_PROGRESS for 2s [ 1122.427033] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('af1da677-d95a-4cec-95fa-b9208101b7dd',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.697535] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.698902] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.698902] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.698902] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.698902] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.698902] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c006a909-f4e1-43d8-bc34-4038d7937297 is going to be created. [ 1122.728658] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.728807] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.728893] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.729191] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.729390] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.754522] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c006a909-f4e1-43d8-bc34-4038d7937297 in Status: UNINITIALIZED for 2s [ 1122.804207] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.804490] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.804559] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.804846] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.804995] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.805166] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Segment Port aa57a5e7-0c57-4eea-9d00-7a44f0a62824 not found, creating... [ 1122.805429] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.805589] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.805701] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.806046] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.806203] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.806495] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.806648] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.806762] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.806971] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.807113] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.807252] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Resource: SegmentPort with ID: aa57a5e7-0c57-4eea-9d00-7a44f0a62824 is going to be created. [ 1122.827291] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.827529] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.827624] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.827901] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.828152] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.828388] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "port-aa57a5e7-0c57-4eea-9d00-7a44f0a62824" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.930862] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('af1da677-d95a-4cec-95fa-b9208101b7dd',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.432525] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.433101] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.433101] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.433101] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.433241] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.433241] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: af1da677-d95a-4cec-95fa-b9208101b7dd is going to be updated. [ 1123.477525] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.477525] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.477525] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.477525] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.477525] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.489154] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af1da677-d95a-4cec-95fa-b9208101b7dd in Status: IN_PROGRESS for 2s [ 1123.562418] env[65337]: INFO networking_nsxv3.common.synchronization [req-12d148b8-027f-42a0-98fc-8b069fc8badd req-621fa3b6-ea91-479e-bc5d-ecfddec6f886 service nova] Enqueued Resource ID: af1da677-d95a-4cec-95fa-b9208101b7dd with Priority: HIGHEST for action security_group_rules [ 1123.562720] env[65337]: INFO networking_nsxv3.common.synchronization [req-12d148b8-027f-42a0-98fc-8b069fc8badd req-621fa3b6-ea91-479e-bc5d-ecfddec6f886 service nova] Enqueued Resource ID: af1da677-d95a-4cec-95fa-b9208101b7dd with Priority: HIGHEST for action security_group_members [ 1123.562911] env[65337]: INFO networking_nsxv3.common.synchronization [req-12d148b8-027f-42a0-98fc-8b069fc8badd req-621fa3b6-ea91-479e-bc5d-ecfddec6f886 service nova] Enqueued Resource ID: aa57a5e7-0c57-4eea-9d00-7a44f0a62824 with Priority: HIGHEST for action port [ 1123.563603] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af1da677-d95a-4cec-95fa-b9208101b7dd with Priority: HIGHEST for action security_group_rules [ 1123.563823] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af1da677-d95a-4cec-95fa-b9208101b7dd with Priority: HIGHEST for action security_group_members [ 1123.563990] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa57a5e7-0c57-4eea-9d00-7a44f0a62824 with Priority: HIGHEST for action port [ 1123.564686] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-af1da677-d95a-4cec-95fa-b9208101b7dd taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.564924] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.565045] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.565296] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.565404] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('af1da677-d95a-4cec-95fa-b9208101b7dd',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.567214] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-af1da677-d95a-4cec-95fa-b9208101b7dd taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.567214] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.567214] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-aa57a5e7-0c57-4eea-9d00-7a44f0a62824 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.567214] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aa57a5e7-0c57-4eea-9d00-7a44f0a62824" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.567560] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aa57a5e7-0c57-4eea-9d00-7a44f0a62824" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.568539] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aa57a5e7-0c57-4eea-9d00-7a44f0a62824" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.568539] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aa57a5e7-0c57-4eea-9d00-7a44f0a62824',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.071042] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-af1da677-d95a-4cec-95fa-b9208101b7dd taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.071042] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.071042] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port aa57a5e7-0c57-4eea-9d00-7a44f0a62824 with status ACTIVE [ 1124.071042] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.071042] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.071042] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.071042] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.071709] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.071709] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.071709] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.071709] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.071709] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.071840] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.072018] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.072126] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.072233] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.072355] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.072486] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.072557] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: aa57a5e7-0c57-4eea-9d00-7a44f0a62824 is going to be updated. [ 1124.087128] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 740ecd60-f1c6-4713-b339-481a878486f1 in Status: SUCCESS [ 1124.087452] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 740ecd60-f1c6-4713-b339-481a878486f1 deletion is rescheduled due to dependency. [ 1124.087604] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.095707] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.095707] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.095707] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.096144] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.096352] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.097082] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aa57a5e7-0c57-4eea-9d00-7a44f0a62824" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.353889] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4a9546d-8cbc-404d-acef-d7856f353fbe in Status: SUCCESS [ 1124.354160] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4a9546d-8cbc-404d-acef-d7856f353fbe" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.354341] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4a9546d-8cbc-404d-acef-d7856f353fbe" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.354607] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4a9546d-8cbc-404d-acef-d7856f353fbe" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.354773] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.354942] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.355022] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.355196] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.355278] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.355365] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4a9546d-8cbc-404d-acef-d7856f353fbe" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.355461] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a4a9546d-8cbc-404d-acef-d7856f353fbe',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.765792] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c006a909-f4e1-43d8-bc34-4038d7937297 in Status: SUCCESS [ 1124.766151] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c006a909-f4e1-43d8-bc34-4038d7937297" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.766441] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c006a909-f4e1-43d8-bc34-4038d7937297" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.766718] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c006a909-f4e1-43d8-bc34-4038d7937297" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.766933] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.767096] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.767164] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.767330] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.767418] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.767504] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c006a909-f4e1-43d8-bc34-4038d7937297" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.767591] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c006a909-f4e1-43d8-bc34-4038d7937297',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.858473] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a4a9546d-8cbc-404d-acef-d7856f353fbe',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.270240] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c006a909-f4e1-43d8-bc34-4038d7937297',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.361043] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a4a9546d-8cbc-404d-acef-d7856f353fbe: rpc.has_security_group_logging(os_id): False [ 1125.380463] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.380708] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.380771] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.381057] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.405204] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.405721] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.405898] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.405980] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.406216] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.406342] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.406445] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a4a9546d-8cbc-404d-acef-d7856f353fbe is going to be updated. [ 1125.474211] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.474412] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.474472] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.474681] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.474936] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.492235] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a4a9546d-8cbc-404d-acef-d7856f353fbe in Status: IN_PROGRESS for 2s [ 1125.499349] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af1da677-d95a-4cec-95fa-b9208101b7dd in Status: SUCCESS [ 1125.499433] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.499536] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.499770] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.499961] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.500095] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.500156] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.500377] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.500474] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.500576] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('af1da677-d95a-4cec-95fa-b9208101b7dd',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.774337] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c006a909-f4e1-43d8-bc34-4038d7937297: rpc.has_security_group_logging(os_id): False [ 1125.794702] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.794702] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.794702] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.794702] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.794702] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.794702] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.794702] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.794702] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.795095] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.795095] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.795095] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c006a909-f4e1-43d8-bc34-4038d7937297 is going to be created. [ 1125.897812] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.898042] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.898093] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.898326] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.898530] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.915490] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c006a909-f4e1-43d8-bc34-4038d7937297 in Status: IN_PROGRESS for 2s [ 1126.003145] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('af1da677-d95a-4cec-95fa-b9208101b7dd',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.505756] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('af1da677-d95a-4cec-95fa-b9208101b7dd',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.009940] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.010718] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.010866] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.012194] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.012194] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.012194] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: af1da677-d95a-4cec-95fa-b9208101b7dd is going to be updated. [ 1127.055323] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.055539] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.055539] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.055702] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.055803] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.065354] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af1da677-d95a-4cec-95fa-b9208101b7dd in Status: IN_PROGRESS for 2s [ 1127.506248] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a4a9546d-8cbc-404d-acef-d7856f353fbe in Status: SUCCESS [ 1127.506698] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a4a9546d-8cbc-404d-acef-d7856f353fbe" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.929351] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c006a909-f4e1-43d8-bc34-4038d7937297 in Status: SUCCESS [ 1127.929639] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c006a909-f4e1-43d8-bc34-4038d7937297" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.564740] env[65337]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1128.565110] env[65337]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1129.078771] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af1da677-d95a-4cec-95fa-b9208101b7dd in Status: SUCCESS [ 1129.079056] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.079259] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.079557] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.079769] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.079916] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.079989] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.080199] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.080292] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.080422] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.080488] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('af1da677-d95a-4cec-95fa-b9208101b7dd',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.583313] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-af1da677-d95a-4cec-95fa-b9208101b7dd taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.583313] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.583978] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.583978] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.583978] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.583978] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.584393] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.584393] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.584485] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.584485] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.584852] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-af1da677-d95a-4cec-95fa-b9208101b7dd taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.584852] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.585384] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.585384] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.585384] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.585735] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.585735] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.585898] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.586233] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.586233] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.586233] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('af1da677-d95a-4cec-95fa-b9208101b7dd',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.053992] env[65337]: INFO networking_nsxv3.common.synchronization [req-3ee018ca-74f7-4b0c-aabc-98914e5af400 req-b123b997-f76c-4f10-bb25-4cef0b749fe5 tempest-ServersTestMultiNic-1422308133 tempest-ServersTestMultiNic-1422308133-project-member] Enqueued Resource ID: 740ecd60-f1c6-4713-b339-481a878486f1 with Priority: HIGHEST for action security_group_members [ 1130.054625] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 740ecd60-f1c6-4713-b339-481a878486f1 with Priority: HIGHEST for action security_group_members [ 1130.054975] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-740ecd60-f1c6-4713-b339-481a878486f1 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.055132] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.055200] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.055394] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.055610] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.055701] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.055701] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.055856] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.056015] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.056098] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('740ecd60-f1c6-4713-b339-481a878486f1',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.088289] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for af1da677-d95a-4cec-95fa-b9208101b7dd: rpc.has_security_group_logging(os_id): False [ 1130.111205] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.111205] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.111205] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.111205] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.111205] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.111749] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.111749] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.111749] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.111918] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.111918] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.112114] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.112858] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.113553] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.113553] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.113553] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.113553] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.113969] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.113969] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.113969] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.113969] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.113969] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: af1da677-d95a-4cec-95fa-b9208101b7dd is going to be updated. [ 1130.202082] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.202277] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.202412] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.202574] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.202726] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.223193] env[65337]: INFO networking_nsxv3.common.synchronization [req-82594faa-47fb-4921-ae1f-458044395156 req-e0db7616-f662-4efe-b658-1ceb510600a8 tempest-DeleteServersTestJSON-1654690426 tempest-DeleteServersTestJSON-1654690426-project-member] Enqueued Resource ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d with Priority: HIGHEST for action security_group_members [ 1130.223500] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: af1da677-d95a-4cec-95fa-b9208101b7dd in Status: IN_PROGRESS for 2s [ 1130.223994] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d with Priority: HIGHEST for action security_group_members [ 1130.224343] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-161889a4-32a2-48ee-8fb7-d2a961a4b28d taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.225031] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.225031] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.225031] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.225031] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.225031] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.225031] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.225322] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.225322] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.225322] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('161889a4-32a2-48ee-8fb7-d2a961a4b28d',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.558608] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.559014] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.559014] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.559243] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.559371] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.559643] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.559759] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.559867] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.560114] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.560204] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.560310] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 740ecd60-f1c6-4713-b339-481a878486f1 is going to be updated. [ 1130.595213] env[65337]: INFO networking_nsxv3.common.synchronization [req-3ee018ca-74f7-4b0c-aabc-98914e5af400 req-9ed5f15f-e9a2-4677-8cdf-6ac56a0239ff tempest-ServersTestMultiNic-1422308133 tempest-ServersTestMultiNic-1422308133-project-member] Enqueued Resource ID: 740ecd60-f1c6-4713-b339-481a878486f1 with Priority: HIGHEST for action security_group_members [ 1130.597913] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.598177] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.598316] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.598650] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.598951] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.601100] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 740ecd60-f1c6-4713-b339-481a878486f1 with Priority: HIGHEST for action security_group_members [ 1130.601644] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-740ecd60-f1c6-4713-b339-481a878486f1 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.601811] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.612209] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 740ecd60-f1c6-4713-b339-481a878486f1 in Status: IN_PROGRESS for 2s [ 1130.727947] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.728286] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.728492] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.728843] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.729032] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.729374] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.729513] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.729578] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.729763] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.729845] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.729964] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d is going to be updated. [ 1130.772994] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.773166] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.773239] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.773794] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.773794] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.784531] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d in Status: IN_PROGRESS for 2s [ 1130.995259] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock network-282 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.995577] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "network-282" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.995778] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "network-282" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.996278] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "network-282" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.996841] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.997100] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.997261] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.997676] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.997754] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.998161] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1130.998443] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1130.998617] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1130.998778] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1131.000101] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1131.000101] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1131.000101] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1131.026509] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1131.026694] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1131.026880] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1131.027108] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "network-282" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.027424] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock port-3d08724f-f3c4-4e80-8dbb-f8dfd13734a8 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.027631] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "port-3d08724f-f3c4-4e80-8dbb-f8dfd13734a8" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.027748] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "port-3d08724f-f3c4-4e80-8dbb-f8dfd13734a8" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.028249] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "port-3d08724f-f3c4-4e80-8dbb-f8dfd13734a8" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.028420] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3d08724f-f3c4-4e80-8dbb-f8dfd13734a8',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.531414] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.531635] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.531757] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.532063] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.532221] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.532436] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Segment Port 3d08724f-f3c4-4e80-8dbb-f8dfd13734a8 not found, creating... [ 1131.532706] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.532865] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.532980] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.533220] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.533417] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.533633] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.533789] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.533947] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.534339] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.534496] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.534649] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Resource: SegmentPort with ID: 3d08724f-f3c4-4e80-8dbb-f8dfd13734a8 is going to be created. [ 1131.565859] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.566233] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.566371] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.566712] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.566962] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.567222] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "port-3d08724f-f3c4-4e80-8dbb-f8dfd13734a8" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.242268] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: af1da677-d95a-4cec-95fa-b9208101b7dd in Status: SUCCESS [ 1132.243233] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.260061] env[65337]: INFO networking_nsxv3.common.synchronization [req-3ee018ca-74f7-4b0c-aabc-98914e5af400 req-f888e210-4b44-475f-ab2e-eefc3f9c2a05 service nova] Enqueued Resource ID: 740ecd60-f1c6-4713-b339-481a878486f1 with Priority: HIGHEST for action security_group_rules [ 1132.260258] env[65337]: INFO networking_nsxv3.common.synchronization [req-3ee018ca-74f7-4b0c-aabc-98914e5af400 req-f888e210-4b44-475f-ab2e-eefc3f9c2a05 service nova] Enqueued Resource ID: 740ecd60-f1c6-4713-b339-481a878486f1 with Priority: HIGHEST for action security_group_members [ 1132.260463] env[65337]: INFO networking_nsxv3.common.synchronization [req-3ee018ca-74f7-4b0c-aabc-98914e5af400 req-f888e210-4b44-475f-ab2e-eefc3f9c2a05 service nova] Enqueued Resource ID: 3d08724f-f3c4-4e80-8dbb-f8dfd13734a8 with Priority: HIGHEST for action port [ 1132.262334] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 740ecd60-f1c6-4713-b339-481a878486f1 with Priority: HIGHEST for action security_group_rules [ 1132.262334] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 740ecd60-f1c6-4713-b339-481a878486f1 with Priority: HIGHEST for action security_group_members [ 1132.262334] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d08724f-f3c4-4e80-8dbb-f8dfd13734a8 with Priority: HIGHEST for action port [ 1132.262334] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-740ecd60-f1c6-4713-b339-481a878486f1 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.262555] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.262555] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.262659] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.262746] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('740ecd60-f1c6-4713-b339-481a878486f1',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.263707] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-740ecd60-f1c6-4713-b339-481a878486f1 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.263818] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.264022] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-3d08724f-f3c4-4e80-8dbb-f8dfd13734a8 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.264299] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3d08724f-f3c4-4e80-8dbb-f8dfd13734a8" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.264299] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3d08724f-f3c4-4e80-8dbb-f8dfd13734a8" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.264410] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3d08724f-f3c4-4e80-8dbb-f8dfd13734a8" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.264462] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3d08724f-f3c4-4e80-8dbb-f8dfd13734a8',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.623259] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 740ecd60-f1c6-4713-b339-481a878486f1 in Status: SUCCESS [ 1132.623469] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 740ecd60-f1c6-4713-b339-481a878486f1 deletion is rescheduled due to dependency. [ 1132.623585] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.623752] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.624052] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.624252] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.624371] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.624437] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.624594] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.624675] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.624771] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('740ecd60-f1c6-4713-b339-481a878486f1',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.766630] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-740ecd60-f1c6-4713-b339-481a878486f1 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.766850] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.766934] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3d08724f-f3c4-4e80-8dbb-f8dfd13734a8 with status ACTIVE [ 1132.767134] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.767245] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.767309] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.767512] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.767601] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.767787] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.767863] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.767989] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.768174] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.768252] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.768448] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.768541] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.768602] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.768738] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.768811] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.768892] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3d08724f-f3c4-4e80-8dbb-f8dfd13734a8 is going to be updated. [ 1132.791316] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.791513] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.791513] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.791730] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.791866] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.792048] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3d08724f-f3c4-4e80-8dbb-f8dfd13734a8" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.794934] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d in Status: SUCCESS [ 1132.795123] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d deletion is rescheduled due to dependency. [ 1132.795231] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.036334] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock network-841 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.036544] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "network-841" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.036668] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "network-841" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.037021] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "network-841" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.037320] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.037479] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.037595] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.037811] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.037951] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.038174] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1133.038323] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1133.038446] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1133.038556] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1133.038670] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1133.038771] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1133.038899] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1133.059305] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1133.059467] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1133.059591] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1133.059796] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "network-841" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.060127] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock port-d354c444-8212-4f4c-a678-6a826870367a taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.060300] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "port-d354c444-8212-4f4c-a678-6a826870367a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.060417] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "port-d354c444-8212-4f4c-a678-6a826870367a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.060737] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "port-d354c444-8212-4f4c-a678-6a826870367a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.060873] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d354c444-8212-4f4c-a678-6a826870367a',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.126740] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('740ecd60-f1c6-4713-b339-481a878486f1',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.564094] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.564476] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.564593] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.564906] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.565088] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.565276] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Segment Port d354c444-8212-4f4c-a678-6a826870367a not found, creating... [ 1133.565562] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.565721] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.565838] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.566132] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.566352] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.566686] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.566842] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.566958] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.567199] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.567378] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.567568] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Resource: SegmentPort with ID: d354c444-8212-4f4c-a678-6a826870367a is going to be created. [ 1133.587813] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.588042] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.588254] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.588633] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.588878] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.589178] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "port-d354c444-8212-4f4c-a678-6a826870367a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.628683] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('740ecd60-f1c6-4713-b339-481a878486f1',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.131429] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.131646] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.131646] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.131860] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.131945] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.132054] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 740ecd60-f1c6-4713-b339-481a878486f1 is going to be updated. [ 1134.161625] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.161810] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.161855] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.162057] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.162204] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.171227] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 740ecd60-f1c6-4713-b339-481a878486f1 in Status: IN_PROGRESS for 2s [ 1134.283049] env[65337]: INFO networking_nsxv3.common.synchronization [req-3ee018ca-74f7-4b0c-aabc-98914e5af400 req-cec040fc-73ee-49f3-9458-9e73b60bb92c service nova] Enqueued Resource ID: 740ecd60-f1c6-4713-b339-481a878486f1 with Priority: HIGHEST for action security_group_rules [ 1134.283241] env[65337]: INFO networking_nsxv3.common.synchronization [req-3ee018ca-74f7-4b0c-aabc-98914e5af400 req-cec040fc-73ee-49f3-9458-9e73b60bb92c service nova] Enqueued Resource ID: 740ecd60-f1c6-4713-b339-481a878486f1 with Priority: HIGHEST for action security_group_members [ 1134.283328] env[65337]: INFO networking_nsxv3.common.synchronization [req-3ee018ca-74f7-4b0c-aabc-98914e5af400 req-cec040fc-73ee-49f3-9458-9e73b60bb92c service nova] Enqueued Resource ID: d354c444-8212-4f4c-a678-6a826870367a with Priority: HIGHEST for action port [ 1134.284108] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 740ecd60-f1c6-4713-b339-481a878486f1 with Priority: HIGHEST for action security_group_rules [ 1134.284384] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 740ecd60-f1c6-4713-b339-481a878486f1 with Priority: HIGHEST for action security_group_members [ 1134.284542] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d354c444-8212-4f4c-a678-6a826870367a with Priority: HIGHEST for action port [ 1134.284912] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-740ecd60-f1c6-4713-b339-481a878486f1 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.285081] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.285339] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-740ecd60-f1c6-4713-b339-481a878486f1 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.285484] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.285713] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-d354c444-8212-4f4c-a678-6a826870367a taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.285863] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d354c444-8212-4f4c-a678-6a826870367a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.286020] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d354c444-8212-4f4c-a678-6a826870367a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.286315] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d354c444-8212-4f4c-a678-6a826870367a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.286433] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d354c444-8212-4f4c-a678-6a826870367a',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.789295] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d354c444-8212-4f4c-a678-6a826870367a with status ACTIVE [ 1134.789547] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.791857] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.791857] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.791857] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.791857] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.791857] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.791857] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.791857] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.791857] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.791857] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.791857] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.791857] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.791857] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.791857] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.791857] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.791857] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d354c444-8212-4f4c-a678-6a826870367a is going to be updated. [ 1134.813262] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.813631] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.813721] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.813934] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.814088] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.814256] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d354c444-8212-4f4c-a678-6a826870367a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.182184] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 740ecd60-f1c6-4713-b339-481a878486f1 in Status: SUCCESS [ 1136.182184] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.182513] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.183125] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.183125] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.183125] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.183125] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.183125] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.183366] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.183366] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('740ecd60-f1c6-4713-b339-481a878486f1',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.585857] env[65337]: INFO networking_nsxv3.common.synchronization [req-c45dcf54-1d14-49ee-bf6a-184ffc371e9a req-77d7ffac-e347-4a86-912b-734245736d4f tempest-ServersTestJSON-1910122825 tempest-ServersTestJSON-1910122825-project-member] Enqueued Resource ID: af1da677-d95a-4cec-95fa-b9208101b7dd with Priority: HIGHEST for action security_group_members [ 1136.586539] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af1da677-d95a-4cec-95fa-b9208101b7dd with Priority: HIGHEST for action security_group_members [ 1136.587357] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-af1da677-d95a-4cec-95fa-b9208101b7dd taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.587357] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.587357] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.587528] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.587638] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.587700] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.587729] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.587994] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.587994] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.588085] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('af1da677-d95a-4cec-95fa-b9208101b7dd',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.686181] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('740ecd60-f1c6-4713-b339-481a878486f1',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.090293] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('af1da677-d95a-4cec-95fa-b9208101b7dd',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.189923] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('740ecd60-f1c6-4713-b339-481a878486f1',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.593234] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('af1da677-d95a-4cec-95fa-b9208101b7dd',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.693076] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.693076] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.693076] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.693302] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.693416] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.693526] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 740ecd60-f1c6-4713-b339-481a878486f1 is going to be updated. [ 1137.722685] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.722882] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.722882] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.723112] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.723259] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.732653] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 740ecd60-f1c6-4713-b339-481a878486f1 in Status: IN_PROGRESS for 2s [ 1138.096204] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.096425] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.096516] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.096795] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.096908] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.097056] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: af1da677-d95a-4cec-95fa-b9208101b7dd is going to be updated. [ 1138.129068] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.129232] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.129303] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.129528] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.129670] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.138976] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af1da677-d95a-4cec-95fa-b9208101b7dd in Status: IN_PROGRESS for 2s [ 1139.743903] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 740ecd60-f1c6-4713-b339-481a878486f1 in Status: SUCCESS [ 1139.744370] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.744576] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.744859] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.745091] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.745217] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.745298] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.745579] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.745667] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.745757] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.745859] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('740ecd60-f1c6-4713-b339-481a878486f1',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.747015] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.747230] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.747414] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.747565] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.747653] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.747831] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.747919] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.748050] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('740ecd60-f1c6-4713-b339-481a878486f1',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.149886] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af1da677-d95a-4cec-95fa-b9208101b7dd in Status: SUCCESS [ 1140.150119] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.251021] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-740ecd60-f1c6-4713-b339-481a878486f1 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.251242] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.251539] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('740ecd60-f1c6-4713-b339-481a878486f1',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.753778] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('740ecd60-f1c6-4713-b339-481a878486f1',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.256871] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.257194] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.257194] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.257396] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.257490] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.257588] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 740ecd60-f1c6-4713-b339-481a878486f1 is going to be updated. [ 1141.293098] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.293304] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.293382] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.293666] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.293874] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.303707] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 740ecd60-f1c6-4713-b339-481a878486f1 in Status: IN_PROGRESS for 2s [ 1141.587556] env[65337]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1141.587556] env[65337]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=3 [ 1143.316927] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 740ecd60-f1c6-4713-b339-481a878486f1 in Status: SUCCESS [ 1143.317298] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.317401] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.317626] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.317817] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.317933] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.317998] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.318161] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.318240] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.318327] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.318478] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-740ecd60-f1c6-4713-b339-481a878486f1 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.318572] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.318627] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.318764] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.318901] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.318987] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.319566] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.319766] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.319881] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.319985] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.320202] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('740ecd60-f1c6-4713-b339-481a878486f1',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.425791] env[65337]: INFO networking_nsxv3.common.synchronization [req-716da212-0496-4032-a5db-e92149ea8f28 req-27a52a96-e058-43f7-af61-f185b92aa95f tempest-ServersTestJSON-1910122825 tempest-ServersTestJSON-1910122825-project-member] Enqueued Resource ID: af1da677-d95a-4cec-95fa-b9208101b7dd with Priority: HIGHEST for action security_group_members [ 1143.426748] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af1da677-d95a-4cec-95fa-b9208101b7dd with Priority: HIGHEST for action security_group_members [ 1143.427364] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-af1da677-d95a-4cec-95fa-b9208101b7dd taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.427364] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.427364] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.427533] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.427713] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.427790] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.427825] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.428072] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.428130] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.428175] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('af1da677-d95a-4cec-95fa-b9208101b7dd',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.822228] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 740ecd60-f1c6-4713-b339-481a878486f1: rpc.has_security_group_logging(os_id): False [ 1143.840901] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.841099] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.841099] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.841340] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.841431] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.841666] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.841782] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.841849] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.841999] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.842085] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.842269] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.842355] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.842418] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.842873] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.842873] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.842972] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.843037] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.843068] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.843198] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.843273] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.843357] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 740ecd60-f1c6-4713-b339-481a878486f1 is going to be updated. [ 1143.923937] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.924445] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.924600] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.924821] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.925036] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.931543] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.931752] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.931801] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.932098] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.932215] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.932507] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.932637] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.932722] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.932933] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.933056] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.933183] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: af1da677-d95a-4cec-95fa-b9208101b7dd is going to be updated. [ 1143.945613] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 740ecd60-f1c6-4713-b339-481a878486f1 in Status: IN_PROGRESS for 2s [ 1144.005025] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.005218] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.005274] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.005649] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.005858] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.017867] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af1da677-d95a-4cec-95fa-b9208101b7dd in Status: IN_PROGRESS for 2s [ 1144.752386] env[65337]: INFO networking_nsxv3.common.synchronization [None req-0182d289-4b79-4805-bb49-b995ccd095c7 None None] Enqueued Resource ID: acf49fe6-de21-45d4-8841-795d0496b148 with Priority: HIGHEST for action port [ 1144.755536] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: acf49fe6-de21-45d4-8841-795d0496b148 with Priority: HIGHEST for action port [ 1144.757015] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-acf49fe6-de21-45d4-8841-795d0496b148 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.757015] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-acf49fe6-de21-45d4-8841-795d0496b148" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.757015] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-acf49fe6-de21-45d4-8841-795d0496b148" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.757165] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-acf49fe6-de21-45d4-8841-795d0496b148" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.757208] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('acf49fe6-de21-45d4-8841-795d0496b148',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.260458] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port acf49fe6-de21-45d4-8841-795d0496b148 [ 1145.260781] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.260842] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.260908] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.261232] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.261278] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.261363] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:acf49fe6-de21-45d4-8841-795d0496b148 already deleted. [ 1145.261490] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-acf49fe6-de21-45d4-8841-795d0496b148" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.701199] env[65337]: INFO networking_nsxv3.common.synchronization [req-faf3a80f-9b59-4e71-a6c7-221c2bccae04 req-75483b0f-8d60-4305-9f32-e038ed1e51a1 tempest-ServersTestMultiNic-1422308133 tempest-ServersTestMultiNic-1422308133-project-member] Enqueued Resource ID: 740ecd60-f1c6-4713-b339-481a878486f1 with Priority: HIGHEST for action security_group_members [ 1145.702081] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 740ecd60-f1c6-4713-b339-481a878486f1 with Priority: HIGHEST for action security_group_members [ 1145.702081] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-740ecd60-f1c6-4713-b339-481a878486f1 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.702081] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.703473] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.703473] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.703473] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.703473] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.703473] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.703473] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.703473] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.703473] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('740ecd60-f1c6-4713-b339-481a878486f1',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.968230] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 740ecd60-f1c6-4713-b339-481a878486f1 in Status: SUCCESS [ 1145.968650] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.968891] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.969359] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.970027] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('740ecd60-f1c6-4713-b339-481a878486f1',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.029348] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af1da677-d95a-4cec-95fa-b9208101b7dd in Status: SUCCESS [ 1146.029537] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: af1da677-d95a-4cec-95fa-b9208101b7dd deletion is rescheduled due to dependency. [ 1146.029650] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.040584] env[65337]: INFO networking_nsxv3.common.synchronization [req-faf3a80f-9b59-4e71-a6c7-221c2bccae04 req-4e112bea-cf30-4f2e-9997-74c6399005cb tempest-ServersTestMultiNic-1422308133 tempest-ServersTestMultiNic-1422308133-project-member] Enqueued Resource ID: 740ecd60-f1c6-4713-b339-481a878486f1 with Priority: HIGHEST for action security_group_members [ 1146.041156] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 740ecd60-f1c6-4713-b339-481a878486f1 with Priority: HIGHEST for action security_group_members [ 1146.041491] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-740ecd60-f1c6-4713-b339-481a878486f1 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.041567] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.204998] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('740ecd60-f1c6-4713-b339-481a878486f1',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.472185] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-740ecd60-f1c6-4713-b339-481a878486f1 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.472532] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.707476] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('740ecd60-f1c6-4713-b339-481a878486f1',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.167947] env[65337]: INFO networking_nsxv3.common.synchronization [None req-c33ad9c6-54c2-440e-9fe5-6a58c94351ca None None] Enqueued Resource ID: a7c0a4f9-64ef-4efa-966c-f082f226660f with Priority: HIGHEST for action port [ 1147.168576] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7c0a4f9-64ef-4efa-966c-f082f226660f with Priority: HIGHEST for action port [ 1147.168893] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-a7c0a4f9-64ef-4efa-966c-f082f226660f taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.170022] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a7c0a4f9-64ef-4efa-966c-f082f226660f" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.170022] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a7c0a4f9-64ef-4efa-966c-f082f226660f" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.170277] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a7c0a4f9-64ef-4efa-966c-f082f226660f" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.170382] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a7c0a4f9-64ef-4efa-966c-f082f226660f',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.209821] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.209821] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.209821] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.210139] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.211033] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.211033] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 740ecd60-f1c6-4713-b339-481a878486f1 is going to be updated. [ 1147.240629] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.240820] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.240820] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.241014] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.241166] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.250646] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 740ecd60-f1c6-4713-b339-481a878486f1 in Status: IN_PROGRESS for 2s [ 1147.673534] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a7c0a4f9-64ef-4efa-966c-f082f226660f [ 1147.673534] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.673534] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.673534] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.673534] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.673534] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.673534] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a7c0a4f9-64ef-4efa-966c-f082f226660f already deleted. [ 1147.673894] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a7c0a4f9-64ef-4efa-966c-f082f226660f" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.262106] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 740ecd60-f1c6-4713-b339-481a878486f1 in Status: SUCCESS [ 1149.262494] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.262494] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.262816] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.263037] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.263166] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.263237] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.263397] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.263474] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.263564] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('740ecd60-f1c6-4713-b339-481a878486f1',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.768193] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.768193] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.768475] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.768580] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.768698] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.768986] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.769191] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.769305] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.769491] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.769598] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.769709] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 740ecd60-f1c6-4713-b339-481a878486f1 is going to be updated. [ 1149.797962] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.798205] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.798205] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.798576] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.798760] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.808342] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 740ecd60-f1c6-4713-b339-481a878486f1 in Status: IN_PROGRESS for 2s [ 1150.941498] env[65337]: INFO networking_nsxv3.common.synchronization [req-8848dd0e-1700-4106-8f48-8e946db4972d req-9cae1c94-6424-4f43-a525-2a2dc96c8984 tempest-MultipleCreateTestJSON-392767123 tempest-MultipleCreateTestJSON-392767123-project-member] Enqueued Resource ID: 01a2d749-abdf-41c6-bf7b-54833d1bf23e with Priority: HIGHEST for action security_group_members [ 1150.943206] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01a2d749-abdf-41c6-bf7b-54833d1bf23e with Priority: HIGHEST for action security_group_members [ 1150.943577] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-01a2d749-abdf-41c6-bf7b-54833d1bf23e taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.943708] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01a2d749-abdf-41c6-bf7b-54833d1bf23e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.943779] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01a2d749-abdf-41c6-bf7b-54833d1bf23e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.944122] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01a2d749-abdf-41c6-bf7b-54833d1bf23e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.944783] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.944904] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.944997] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.945208] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.945301] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.945375] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('01a2d749-abdf-41c6-bf7b-54833d1bf23e',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.283055] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock network-686 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.283275] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "network-686" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.283398] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "network-686" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.283745] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "network-686" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.284119] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.284301] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.284418] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.284660] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.284805] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.285019] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1151.285137] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1151.285241] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1151.285351] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1151.285459] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1151.285599] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1151.285729] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1151.306166] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1151.306370] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1151.306512] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1151.306690] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "network-686" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.307059] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock port-4b446f18-5f63-40c1-82f2-4f952a3dfb18 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.307218] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "port-4b446f18-5f63-40c1-82f2-4f952a3dfb18" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.307378] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "port-4b446f18-5f63-40c1-82f2-4f952a3dfb18" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.307717] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "port-4b446f18-5f63-40c1-82f2-4f952a3dfb18" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.307926] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4b446f18-5f63-40c1-82f2-4f952a3dfb18',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.448177] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.448384] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.448540] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.448827] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.448980] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.449260] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.449496] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.449588] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.449765] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.449860] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.450017] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01a2d749-abdf-41c6-bf7b-54833d1bf23e already deleted. [ 1151.450087] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01a2d749-abdf-41c6-bf7b-54833d1bf23e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.810167] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.810541] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.810697] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.811044] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.811251] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.811427] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Segment Port 4b446f18-5f63-40c1-82f2-4f952a3dfb18 not found, creating... [ 1151.811705] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.811855] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.811970] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.812352] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.812352] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.812758] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.812924] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.813054] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.813263] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.813396] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.813534] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Resource: SegmentPort with ID: 4b446f18-5f63-40c1-82f2-4f952a3dfb18 is going to be created. [ 1151.823063] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 740ecd60-f1c6-4713-b339-481a878486f1 in Status: SUCCESS [ 1151.823264] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 740ecd60-f1c6-4713-b339-481a878486f1 deletion is rescheduled due to dependency. [ 1151.823350] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.823504] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.823692] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.823869] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.823994] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.824093] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.824242] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.824338] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.824393] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.824483] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('740ecd60-f1c6-4713-b339-481a878486f1',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.833339] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.834028] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.834028] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.834028] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.834184] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.834436] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "port-4b446f18-5f63-40c1-82f2-4f952a3dfb18" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.326600] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-740ecd60-f1c6-4713-b339-481a878486f1 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.326959] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.326959] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.327105] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.327281] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.327388] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.327454] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.327613] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.327699] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.327824] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.327966] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-740ecd60-f1c6-4713-b339-481a878486f1 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.328050] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.328088] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.328231] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.328369] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.328459] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.328518] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.328669] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.328718] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.328800] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.328889] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('740ecd60-f1c6-4713-b339-481a878486f1',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.588275] env[65337]: INFO networking_nsxv3.common.synchronization [req-8848dd0e-1700-4106-8f48-8e946db4972d req-1bff001b-191d-4b85-8505-2dc2ab0b8d3c service nova] Enqueued Resource ID: 01a2d749-abdf-41c6-bf7b-54833d1bf23e with Priority: HIGHEST for action security_group_rules [ 1152.588463] env[65337]: INFO networking_nsxv3.common.synchronization [req-8848dd0e-1700-4106-8f48-8e946db4972d req-1bff001b-191d-4b85-8505-2dc2ab0b8d3c service nova] Enqueued Resource ID: 01a2d749-abdf-41c6-bf7b-54833d1bf23e with Priority: HIGHEST for action security_group_members [ 1152.588599] env[65337]: INFO networking_nsxv3.common.synchronization [req-8848dd0e-1700-4106-8f48-8e946db4972d req-1bff001b-191d-4b85-8505-2dc2ab0b8d3c service nova] Enqueued Resource ID: 4b446f18-5f63-40c1-82f2-4f952a3dfb18 with Priority: HIGHEST for action port [ 1152.589124] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01a2d749-abdf-41c6-bf7b-54833d1bf23e with Priority: HIGHEST for action security_group_rules [ 1152.589314] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01a2d749-abdf-41c6-bf7b-54833d1bf23e with Priority: HIGHEST for action security_group_members [ 1152.589350] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b446f18-5f63-40c1-82f2-4f952a3dfb18 with Priority: HIGHEST for action port [ 1152.589620] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-01a2d749-abdf-41c6-bf7b-54833d1bf23e taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.589739] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-01a2d749-abdf-41c6-bf7b-54833d1bf23e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.589805] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-01a2d749-abdf-41c6-bf7b-54833d1bf23e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.590110] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-01a2d749-abdf-41c6-bf7b-54833d1bf23e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.590203] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('01a2d749-abdf-41c6-bf7b-54833d1bf23e',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.591407] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-01a2d749-abdf-41c6-bf7b-54833d1bf23e taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.591524] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01a2d749-abdf-41c6-bf7b-54833d1bf23e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.591591] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01a2d749-abdf-41c6-bf7b-54833d1bf23e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.591760] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01a2d749-abdf-41c6-bf7b-54833d1bf23e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.591907] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.592012] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.592079] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.592223] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.592309] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.592396] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('01a2d749-abdf-41c6-bf7b-54833d1bf23e',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.593129] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-4b446f18-5f63-40c1-82f2-4f952a3dfb18 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.593236] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4b446f18-5f63-40c1-82f2-4f952a3dfb18" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.593303] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4b446f18-5f63-40c1-82f2-4f952a3dfb18" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.594362] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4b446f18-5f63-40c1-82f2-4f952a3dfb18" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.594472] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4b446f18-5f63-40c1-82f2-4f952a3dfb18',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.831563] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 740ecd60-f1c6-4713-b339-481a878486f1: rpc.has_security_group_logging(os_id): False [ 1152.850753] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.850976] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.851039] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.851316] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.851438] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.851713] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.851841] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.851931] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.852150] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.852542] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.852542] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.852681] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.852681] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.852855] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.852954] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.853238] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.853356] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.853438] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.853616] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.853725] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.853842] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 740ecd60-f1c6-4713-b339-481a878486f1 is going to be updated. [ 1152.930892] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.931059] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.931131] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.931345] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.931481] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.950144] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 740ecd60-f1c6-4713-b339-481a878486f1 in Status: IN_PROGRESS for 2s [ 1153.096602] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('01a2d749-abdf-41c6-bf7b-54833d1bf23e',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.097990] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-01a2d749-abdf-41c6-bf7b-54833d1bf23e taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.098163] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01a2d749-abdf-41c6-bf7b-54833d1bf23e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.098645] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4b446f18-5f63-40c1-82f2-4f952a3dfb18 with status ACTIVE [ 1153.098873] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.099039] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.099139] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.099413] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.099542] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.099796] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.099912] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.100013] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.100239] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.100356] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.100611] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.100848] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.100848] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.101046] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.101203] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.101275] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4b446f18-5f63-40c1-82f2-4f952a3dfb18 is going to be updated. [ 1153.125490] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.125698] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.125698] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.125906] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.126060] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.126255] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4b446f18-5f63-40c1-82f2-4f952a3dfb18" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.273117] env[65337]: INFO networking_nsxv3.common.synchronization [req-8848dd0e-1700-4106-8f48-8e946db4972d req-b263f91e-e0cd-47ab-8f52-e6b1ff19c45c tempest-MultipleCreateTestJSON-392767123 tempest-MultipleCreateTestJSON-392767123-project-member] Enqueued Resource ID: 01a2d749-abdf-41c6-bf7b-54833d1bf23e with Priority: HIGHEST for action security_group_members [ 1153.273649] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01a2d749-abdf-41c6-bf7b-54833d1bf23e with Priority: HIGHEST for action security_group_members [ 1153.273993] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-01a2d749-abdf-41c6-bf7b-54833d1bf23e taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.274097] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01a2d749-abdf-41c6-bf7b-54833d1bf23e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.553134] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock network-686 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.553134] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "network-686" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.553134] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "network-686" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.553509] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "network-686" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.553509] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.553649] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.553761] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.553986] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.554162] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.554370] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1153.554481] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1153.554592] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1153.554689] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1153.554794] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1153.554909] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1153.555048] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1153.573149] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1153.573326] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1153.573463] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1153.573630] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "network-686" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.573951] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock port-dfb18420-7235-43ed-9eb8-97844f7daecd taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.574174] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "port-dfb18420-7235-43ed-9eb8-97844f7daecd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.574326] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "port-dfb18420-7235-43ed-9eb8-97844f7daecd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.574648] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "port-dfb18420-7235-43ed-9eb8-97844f7daecd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.574787] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dfb18420-7235-43ed-9eb8-97844f7daecd',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.599451] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('01a2d749-abdf-41c6-bf7b-54833d1bf23e',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.079043] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.079464] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.079618] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.079907] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.080062] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.080323] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Segment Port dfb18420-7235-43ed-9eb8-97844f7daecd not found, creating... [ 1154.080650] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.080815] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.080933] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.081169] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.081395] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.081703] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.081862] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.081978] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.082201] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.082336] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.082474] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Resource: SegmentPort with ID: dfb18420-7235-43ed-9eb8-97844f7daecd is going to be created. [ 1154.101488] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.101660] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.101734] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.101946] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.102057] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.102179] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01a2d749-abdf-41c6-bf7b-54833d1bf23e is going to be created. [ 1154.104491] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.104562] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.104741] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.105209] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.105540] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.105819] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "port-dfb18420-7235-43ed-9eb8-97844f7daecd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.129036] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.129271] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.129353] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.129617] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.129824] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.146025] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01a2d749-abdf-41c6-bf7b-54833d1bf23e in Status: UNINITIALIZED for 2s [ 1154.813071] env[65337]: INFO networking_nsxv3.common.synchronization [req-8848dd0e-1700-4106-8f48-8e946db4972d req-36ca587c-16ab-48e6-a1a7-d13bc3756d54 service nova] Enqueued Resource ID: 01a2d749-abdf-41c6-bf7b-54833d1bf23e with Priority: HIGHEST for action security_group_rules [ 1154.813429] env[65337]: INFO networking_nsxv3.common.synchronization [req-8848dd0e-1700-4106-8f48-8e946db4972d req-36ca587c-16ab-48e6-a1a7-d13bc3756d54 service nova] Enqueued Resource ID: 01a2d749-abdf-41c6-bf7b-54833d1bf23e with Priority: HIGHEST for action security_group_members [ 1154.813593] env[65337]: INFO networking_nsxv3.common.synchronization [req-8848dd0e-1700-4106-8f48-8e946db4972d req-36ca587c-16ab-48e6-a1a7-d13bc3756d54 service nova] Enqueued Resource ID: dfb18420-7235-43ed-9eb8-97844f7daecd with Priority: HIGHEST for action port [ 1154.814637] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01a2d749-abdf-41c6-bf7b-54833d1bf23e with Priority: HIGHEST for action security_group_rules [ 1154.814713] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01a2d749-abdf-41c6-bf7b-54833d1bf23e with Priority: HIGHEST for action security_group_members [ 1154.814816] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dfb18420-7235-43ed-9eb8-97844f7daecd with Priority: HIGHEST for action port [ 1154.815137] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-01a2d749-abdf-41c6-bf7b-54833d1bf23e taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.815262] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-01a2d749-abdf-41c6-bf7b-54833d1bf23e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.815437] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-01a2d749-abdf-41c6-bf7b-54833d1bf23e taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.815512] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01a2d749-abdf-41c6-bf7b-54833d1bf23e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.815718] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-dfb18420-7235-43ed-9eb8-97844f7daecd taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.818066] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dfb18420-7235-43ed-9eb8-97844f7daecd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.818148] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dfb18420-7235-43ed-9eb8-97844f7daecd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.818384] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dfb18420-7235-43ed-9eb8-97844f7daecd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.818490] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dfb18420-7235-43ed-9eb8-97844f7daecd',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.968677] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 740ecd60-f1c6-4713-b339-481a878486f1 in Status: SUCCESS [ 1154.968677] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-740ecd60-f1c6-4713-b339-481a878486f1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.252312] env[65337]: INFO networking_nsxv3.common.synchronization [req-95ba63fb-d070-45ca-8d7e-28538f1bee05 req-ab7a8b2d-ed00-4c82-a308-165b9849e308 tempest-AttachVolumeTestJSON-1666012690 tempest-AttachVolumeTestJSON-1666012690-project-member] Enqueued Resource ID: 6fd84ddb-97c2-4cc9-882e-251b1b1dd2f6 with Priority: HIGHEST for action security_group_members [ 1155.253784] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fd84ddb-97c2-4cc9-882e-251b1b1dd2f6 with Priority: HIGHEST for action security_group_members [ 1155.253784] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-6fd84ddb-97c2-4cc9-882e-251b1b1dd2f6 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.253784] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6fd84ddb-97c2-4cc9-882e-251b1b1dd2f6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.253784] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6fd84ddb-97c2-4cc9-882e-251b1b1dd2f6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.253784] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6fd84ddb-97c2-4cc9-882e-251b1b1dd2f6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.253784] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.253784] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.253784] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.254231] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.254231] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.254231] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6fd84ddb-97c2-4cc9-882e-251b1b1dd2f6',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.323656] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dfb18420-7235-43ed-9eb8-97844f7daecd with status ACTIVE [ 1155.327082] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.327082] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.327082] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.327082] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.327082] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.327082] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.327082] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.327082] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.327082] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.327082] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.327082] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.327082] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.327082] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.327082] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.327082] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.327082] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dfb18420-7235-43ed-9eb8-97844f7daecd is going to be updated. [ 1155.351576] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.351745] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.351784] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.351991] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.352145] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.352309] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dfb18420-7235-43ed-9eb8-97844f7daecd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.757269] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.757442] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.757513] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.757771] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.783787] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.784072] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.784196] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.784267] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.784486] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.784567] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.784656] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6fd84ddb-97c2-4cc9-882e-251b1b1dd2f6 is going to be updated. [ 1155.816530] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.816932] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.816932] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.817038] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.817132] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.825651] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6fd84ddb-97c2-4cc9-882e-251b1b1dd2f6 in Status: IN_PROGRESS for 2s [ 1156.155724] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01a2d749-abdf-41c6-bf7b-54833d1bf23e in Status: SUCCESS [ 1156.155958] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01a2d749-abdf-41c6-bf7b-54833d1bf23e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.156163] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01a2d749-abdf-41c6-bf7b-54833d1bf23e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.156388] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01a2d749-abdf-41c6-bf7b-54833d1bf23e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.156672] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.156748] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.156748] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.156899] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.156970] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.157117] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01a2d749-abdf-41c6-bf7b-54833d1bf23e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.157262] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('01a2d749-abdf-41c6-bf7b-54833d1bf23e',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.158030] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01a2d749-abdf-41c6-bf7b-54833d1bf23e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.158283] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01a2d749-abdf-41c6-bf7b-54833d1bf23e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.158359] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.158420] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.158814] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.158814] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.158814] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.158814] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('01a2d749-abdf-41c6-bf7b-54833d1bf23e',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.660479] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-01a2d749-abdf-41c6-bf7b-54833d1bf23e taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.660635] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01a2d749-abdf-41c6-bf7b-54833d1bf23e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.660819] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('01a2d749-abdf-41c6-bf7b-54833d1bf23e',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.164122] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('01a2d749-abdf-41c6-bf7b-54833d1bf23e',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.668151] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.668383] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.668483] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.668692] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.668795] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.668888] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01a2d749-abdf-41c6-bf7b-54833d1bf23e is going to be updated. [ 1157.700093] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.700318] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.700549] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.700707] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.700773] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.710254] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01a2d749-abdf-41c6-bf7b-54833d1bf23e in Status: IN_PROGRESS for 2s [ 1157.836700] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6fd84ddb-97c2-4cc9-882e-251b1b1dd2f6 in Status: SUCCESS [ 1157.836980] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6fd84ddb-97c2-4cc9-882e-251b1b1dd2f6 deletion is rescheduled due to dependency. [ 1157.837172] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6fd84ddb-97c2-4cc9-882e-251b1b1dd2f6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.722377] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01a2d749-abdf-41c6-bf7b-54833d1bf23e in Status: SUCCESS [ 1159.722377] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01a2d749-abdf-41c6-bf7b-54833d1bf23e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.722837] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01a2d749-abdf-41c6-bf7b-54833d1bf23e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.722837] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01a2d749-abdf-41c6-bf7b-54833d1bf23e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.723031] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.723204] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.723297] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.723482] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.723594] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.723704] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('01a2d749-abdf-41c6-bf7b-54833d1bf23e',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.225637] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('01a2d749-abdf-41c6-bf7b-54833d1bf23e',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.253312] env[65337]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1160.253526] env[65337]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=3 [ 1160.727682] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('01a2d749-abdf-41c6-bf7b-54833d1bf23e',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.230724] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.230975] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.230975] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.231166] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.231262] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.231361] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01a2d749-abdf-41c6-bf7b-54833d1bf23e is going to be updated. [ 1161.259795] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.259994] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.260058] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.260285] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.260435] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.269583] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01a2d749-abdf-41c6-bf7b-54833d1bf23e in Status: IN_PROGRESS for 2s [ 1162.462672] env[65337]: INFO networking_nsxv3.common.synchronization [None req-8f9fc742-9736-46d2-839d-6a23f87fb563 tempest-AttachVolumeTestJSON-1666012690 tempest-AttachVolumeTestJSON-1666012690-project-member] Enqueued Resource ID: 6d469e76-9ef3-431d-9a07-dc20e79dbd4e with Priority: HIGHEST for action security_group_rules [ 1162.463229] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d469e76-9ef3-431d-9a07-dc20e79dbd4e with Priority: HIGHEST for action security_group_rules [ 1162.463532] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6d469e76-9ef3-431d-9a07-dc20e79dbd4e taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.463753] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6d469e76-9ef3-431d-9a07-dc20e79dbd4e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.463822] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6d469e76-9ef3-431d-9a07-dc20e79dbd4e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.464109] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6d469e76-9ef3-431d-9a07-dc20e79dbd4e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.464209] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6d469e76-9ef3-431d-9a07-dc20e79dbd4e',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.548045] env[65337]: INFO networking_nsxv3.common.synchronization [None req-33faab4f-f612-4dd2-a723-411c192e945f tempest-AttachVolumeTestJSON-1666012690 tempest-AttachVolumeTestJSON-1666012690-project-member] Enqueued Resource ID: 6d469e76-9ef3-431d-9a07-dc20e79dbd4e with Priority: HIGHEST for action security_group_rules [ 1162.548711] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d469e76-9ef3-431d-9a07-dc20e79dbd4e with Priority: HIGHEST for action security_group_rules [ 1162.549077] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6d469e76-9ef3-431d-9a07-dc20e79dbd4e taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.549224] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6d469e76-9ef3-431d-9a07-dc20e79dbd4e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.989046] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.989279] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.989368] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.989653] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.989826] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.989996] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6d469e76-9ef3-431d-9a07-dc20e79dbd4e already deleted. [ 1162.990161] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6d469e76-9ef3-431d-9a07-dc20e79dbd4e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.990411] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6d469e76-9ef3-431d-9a07-dc20e79dbd4e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.990675] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6d469e76-9ef3-431d-9a07-dc20e79dbd4e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.990892] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6d469e76-9ef3-431d-9a07-dc20e79dbd4e',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.279264] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01a2d749-abdf-41c6-bf7b-54833d1bf23e in Status: SUCCESS [ 1163.279479] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01a2d749-abdf-41c6-bf7b-54833d1bf23e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.279673] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01a2d749-abdf-41c6-bf7b-54833d1bf23e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.279954] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01a2d749-abdf-41c6-bf7b-54833d1bf23e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.280209] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.280407] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.280514] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.280736] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.280842] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.280950] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01a2d749-abdf-41c6-bf7b-54833d1bf23e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.281194] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-01a2d749-abdf-41c6-bf7b-54833d1bf23e taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.281317] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01a2d749-abdf-41c6-bf7b-54833d1bf23e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.281391] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01a2d749-abdf-41c6-bf7b-54833d1bf23e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.281593] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01a2d749-abdf-41c6-bf7b-54833d1bf23e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.281757] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.281877] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.281967] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.282258] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.282395] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.282493] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01a2d749-abdf-41c6-bf7b-54833d1bf23e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.282582] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('01a2d749-abdf-41c6-bf7b-54833d1bf23e',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.512649] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.513074] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.513074] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.513074] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.513268] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.513268] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6d469e76-9ef3-431d-9a07-dc20e79dbd4e already deleted. [ 1163.513336] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6d469e76-9ef3-431d-9a07-dc20e79dbd4e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.786050] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 01a2d749-abdf-41c6-bf7b-54833d1bf23e: rpc.has_security_group_logging(os_id): False [ 1163.808202] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.808309] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.808309] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.808556] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.808647] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.808869] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.808965] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.809041] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.809200] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.809270] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.809455] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.809544] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.809597] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.809732] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.809803] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.809977] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.810082] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.810142] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.810290] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.810364] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.810450] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 01a2d749-abdf-41c6-bf7b-54833d1bf23e is going to be created. [ 1163.878287] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.878468] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.878527] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.878742] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.878924] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.889273] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 01a2d749-abdf-41c6-bf7b-54833d1bf23e in Status: IN_PROGRESS for 2s [ 1165.903701] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 01a2d749-abdf-41c6-bf7b-54833d1bf23e in Status: SUCCESS [ 1165.904030] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-01a2d749-abdf-41c6-bf7b-54833d1bf23e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.904137] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-01a2d749-abdf-41c6-bf7b-54833d1bf23e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.904318] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-01a2d749-abdf-41c6-bf7b-54833d1bf23e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.904418] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('01a2d749-abdf-41c6-bf7b-54833d1bf23e',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.406634] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-01a2d749-abdf-41c6-bf7b-54833d1bf23e taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.406903] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01a2d749-abdf-41c6-bf7b-54833d1bf23e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.407018] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01a2d749-abdf-41c6-bf7b-54833d1bf23e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.407286] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01a2d749-abdf-41c6-bf7b-54833d1bf23e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.407571] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.407725] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.407800] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.408030] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.408181] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.408335] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01a2d749-abdf-41c6-bf7b-54833d1bf23e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.408516] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('01a2d749-abdf-41c6-bf7b-54833d1bf23e',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.910716] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-01a2d749-abdf-41c6-bf7b-54833d1bf23e taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.911088] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01a2d749-abdf-41c6-bf7b-54833d1bf23e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.911088] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01a2d749-abdf-41c6-bf7b-54833d1bf23e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.911224] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01a2d749-abdf-41c6-bf7b-54833d1bf23e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.911412] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.911545] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.911611] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.911807] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.911897] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.911984] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01a2d749-abdf-41c6-bf7b-54833d1bf23e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.912144] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-01a2d749-abdf-41c6-bf7b-54833d1bf23e taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.912237] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01a2d749-abdf-41c6-bf7b-54833d1bf23e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.912327] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01a2d749-abdf-41c6-bf7b-54833d1bf23e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.912470] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01a2d749-abdf-41c6-bf7b-54833d1bf23e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.912603] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.912692] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.912766] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.912900] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.912986] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.913077] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01a2d749-abdf-41c6-bf7b-54833d1bf23e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.913184] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('01a2d749-abdf-41c6-bf7b-54833d1bf23e',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.417737] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 01a2d749-abdf-41c6-bf7b-54833d1bf23e: rpc.has_security_group_logging(os_id): False [ 1167.436828] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.437065] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.437065] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.437314] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.437407] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.437636] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.437729] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.438434] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.438434] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.438434] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.438434] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.438434] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.438434] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.438659] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.438738] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.438947] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.439086] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.439166] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.439334] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.439408] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.439498] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 01a2d749-abdf-41c6-bf7b-54833d1bf23e is going to be updated. [ 1167.503186] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.503739] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.504162] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.505069] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.505294] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.519429] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 01a2d749-abdf-41c6-bf7b-54833d1bf23e in Status: IN_PROGRESS for 2s [ 1167.552347] env[65337]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1167.552636] env[65337]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1167.616969] env[65337]: INFO networking_nsxv3.common.synchronization [req-6d823b92-911b-4bc0-9c17-cc54bbb7e96d req-519a4294-e4bb-4637-9d99-cc6969f4ce04 tempest-MultipleCreateTestJSON-392767123 tempest-MultipleCreateTestJSON-392767123-project-member] Enqueued Resource ID: 01a2d749-abdf-41c6-bf7b-54833d1bf23e with Priority: HIGHEST for action security_group_members [ 1167.621542] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01a2d749-abdf-41c6-bf7b-54833d1bf23e with Priority: HIGHEST for action security_group_members [ 1167.621542] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-01a2d749-abdf-41c6-bf7b-54833d1bf23e taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.621542] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01a2d749-abdf-41c6-bf7b-54833d1bf23e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.621542] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01a2d749-abdf-41c6-bf7b-54833d1bf23e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.621542] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01a2d749-abdf-41c6-bf7b-54833d1bf23e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.621542] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.621542] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.621542] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.621542] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.621542] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.621542] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('01a2d749-abdf-41c6-bf7b-54833d1bf23e',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.115202] env[65337]: INFO networking_nsxv3.common.synchronization [req-ced748ca-cfff-4020-a5af-1a7ad0a10634 req-37deb907-00bd-4e62-95b3-81422d679a48 tempest-MultipleCreateTestJSON-392767123 tempest-MultipleCreateTestJSON-392767123-project-member] Enqueued Resource ID: 01a2d749-abdf-41c6-bf7b-54833d1bf23e with Priority: HIGHEST for action security_group_members [ 1168.115856] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01a2d749-abdf-41c6-bf7b-54833d1bf23e with Priority: HIGHEST for action security_group_members [ 1168.116462] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-01a2d749-abdf-41c6-bf7b-54833d1bf23e taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.116462] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01a2d749-abdf-41c6-bf7b-54833d1bf23e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.122507] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('01a2d749-abdf-41c6-bf7b-54833d1bf23e',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.624316] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('01a2d749-abdf-41c6-bf7b-54833d1bf23e',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.122129] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock network-574 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.122449] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "network-574" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.122449] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "network-574" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.122717] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "network-574" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.122978] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.123149] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.123289] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.123499] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.123639] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.123845] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1169.123957] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1169.124101] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1169.124242] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1169.124358] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1169.124464] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1169.124597] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1169.126042] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.126187] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.126269] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.126407] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.126490] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.126581] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01a2d749-abdf-41c6-bf7b-54833d1bf23e is going to be updated. [ 1169.148027] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1169.148027] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1169.148027] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1169.148027] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "network-574" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.148577] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock port-d98cb01f-bc3b-4a14-b7a0-7bbabcc9f1d2 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.149031] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "port-d98cb01f-bc3b-4a14-b7a0-7bbabcc9f1d2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.149031] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "port-d98cb01f-bc3b-4a14-b7a0-7bbabcc9f1d2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.149234] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "port-d98cb01f-bc3b-4a14-b7a0-7bbabcc9f1d2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.149405] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d98cb01f-bc3b-4a14-b7a0-7bbabcc9f1d2',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.160582] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.160719] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.161142] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.161142] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.161392] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.173922] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01a2d749-abdf-41c6-bf7b-54833d1bf23e in Status: IN_PROGRESS for 2s [ 1169.534140] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 01a2d749-abdf-41c6-bf7b-54833d1bf23e in Status: SUCCESS [ 1169.534369] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-01a2d749-abdf-41c6-bf7b-54833d1bf23e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.652879] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.653181] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.653312] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.653593] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.653740] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.654086] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.654251] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.654387] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.654640] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.654779] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.655220] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.655220] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.655410] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.655528] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.655676] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.655827] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Resource: SegmentPort with ID: d98cb01f-bc3b-4a14-b7a0-7bbabcc9f1d2 is going to be updated. [ 1169.678826] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.679090] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.679226] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.679521] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.679715] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.679941] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "port-d98cb01f-bc3b-4a14-b7a0-7bbabcc9f1d2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.624765] env[65337]: INFO networking_nsxv3.common.synchronization [req-3a911741-1994-4f74-b97e-e31ad9cd8f60 req-6a147e13-788d-4f35-af05-e14f43cc13ea tempest-ServersTestFqdnHostnames-2010354875 tempest-ServersTestFqdnHostnames-2010354875-project-member] Enqueued Resource ID: c006a909-f4e1-43d8-bc34-4038d7937297 with Priority: HIGHEST for action security_group_members [ 1170.625368] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c006a909-f4e1-43d8-bc34-4038d7937297 with Priority: HIGHEST for action security_group_members [ 1170.625756] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-c006a909-f4e1-43d8-bc34-4038d7937297 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.626267] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c006a909-f4e1-43d8-bc34-4038d7937297" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.626267] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c006a909-f4e1-43d8-bc34-4038d7937297" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.626267] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c006a909-f4e1-43d8-bc34-4038d7937297" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.626418] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.626546] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.626639] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.626811] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.626937] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.626982] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c006a909-f4e1-43d8-bc34-4038d7937297',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.828170] env[65337]: INFO networking_nsxv3.common.synchronization [req-f62f8972-37e7-4b01-9c92-ad0c771c5fa8 req-2f761f98-cc38-499a-aeb1-90cdd32a3a78 service nova] Enqueued Resource ID: d4ff60fe-3407-42aa-b33c-6254779ad495 with Priority: HIGHEST for action security_group_rules [ 1170.828304] env[65337]: INFO networking_nsxv3.common.synchronization [req-f62f8972-37e7-4b01-9c92-ad0c771c5fa8 req-2f761f98-cc38-499a-aeb1-90cdd32a3a78 service nova] Enqueued Resource ID: d4ff60fe-3407-42aa-b33c-6254779ad495 with Priority: HIGHEST for action security_group_members [ 1170.828822] env[65337]: INFO networking_nsxv3.common.synchronization [req-f62f8972-37e7-4b01-9c92-ad0c771c5fa8 req-2f761f98-cc38-499a-aeb1-90cdd32a3a78 service nova] Enqueued Resource ID: d98cb01f-bc3b-4a14-b7a0-7bbabcc9f1d2 with Priority: HIGHEST for action port [ 1170.831258] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4ff60fe-3407-42aa-b33c-6254779ad495 with Priority: HIGHEST for action security_group_rules [ 1170.831258] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4ff60fe-3407-42aa-b33c-6254779ad495 with Priority: HIGHEST for action security_group_members [ 1170.831258] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d98cb01f-bc3b-4a14-b7a0-7bbabcc9f1d2 with Priority: HIGHEST for action port [ 1170.831258] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d4ff60fe-3407-42aa-b33c-6254779ad495 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.831258] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d4ff60fe-3407-42aa-b33c-6254779ad495" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.831258] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d4ff60fe-3407-42aa-b33c-6254779ad495" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.831258] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d4ff60fe-3407-42aa-b33c-6254779ad495" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.831258] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d4ff60fe-3407-42aa-b33c-6254779ad495',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.832789] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4ff60fe-3407-42aa-b33c-6254779ad495 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.834389] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4ff60fe-3407-42aa-b33c-6254779ad495" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.834389] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4ff60fe-3407-42aa-b33c-6254779ad495" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.834389] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4ff60fe-3407-42aa-b33c-6254779ad495" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.834389] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.834389] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.834389] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.834389] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.834389] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.836275] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d4ff60fe-3407-42aa-b33c-6254779ad495',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.837308] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-d98cb01f-bc3b-4a14-b7a0-7bbabcc9f1d2 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.837888] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d98cb01f-bc3b-4a14-b7a0-7bbabcc9f1d2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.838076] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d98cb01f-bc3b-4a14-b7a0-7bbabcc9f1d2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.838370] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d98cb01f-bc3b-4a14-b7a0-7bbabcc9f1d2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.838542] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d98cb01f-bc3b-4a14-b7a0-7bbabcc9f1d2',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.129432] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.129587] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.129645] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.129863] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.129954] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.130164] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.130265] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.130328] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.130478] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.130552] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.130635] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c006a909-f4e1-43d8-bc34-4038d7937297 is going to be updated. [ 1171.155348] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.155548] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.155591] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.155779] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.155922] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.163876] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c006a909-f4e1-43d8-bc34-4038d7937297 in Status: IN_PROGRESS for 2s [ 1171.184518] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01a2d749-abdf-41c6-bf7b-54833d1bf23e in Status: SUCCESS [ 1171.184735] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01a2d749-abdf-41c6-bf7b-54833d1bf23e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.184895] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01a2d749-abdf-41c6-bf7b-54833d1bf23e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.185166] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01a2d749-abdf-41c6-bf7b-54833d1bf23e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.185369] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.185489] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.185555] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.185738] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.186513] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.186659] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('01a2d749-abdf-41c6-bf7b-54833d1bf23e',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.340653] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d4ff60fe-3407-42aa-b33c-6254779ad495',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.341431] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4ff60fe-3407-42aa-b33c-6254779ad495 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.341581] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4ff60fe-3407-42aa-b33c-6254779ad495" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.341765] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d98cb01f-bc3b-4a14-b7a0-7bbabcc9f1d2 with status ACTIVE [ 1171.342050] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.342678] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.342678] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.342678] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.342832] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.344043] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.344043] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.344043] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.344043] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.344043] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.344043] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.344043] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.344043] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.344043] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.344043] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.344043] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d98cb01f-bc3b-4a14-b7a0-7bbabcc9f1d2 is going to be updated. [ 1171.373803] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.374052] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.374052] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.374310] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.375040] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.375040] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d98cb01f-bc3b-4a14-b7a0-7bbabcc9f1d2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.690725] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.691174] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.691174] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.691174] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.691349] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.691708] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.691708] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.691708] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.691928] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.692060] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.692099] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01a2d749-abdf-41c6-bf7b-54833d1bf23e is going to be updated. [ 1171.721782] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.721992] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.722123] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.722362] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.722571] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.736920] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01a2d749-abdf-41c6-bf7b-54833d1bf23e in Status: IN_PROGRESS for 2s [ 1171.846459] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d4ff60fe-3407-42aa-b33c-6254779ad495',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.349310] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.349559] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.349559] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.349760] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.349851] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.349948] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d4ff60fe-3407-42aa-b33c-6254779ad495 is going to be updated. [ 1172.384158] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.384397] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.384397] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.384595] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.384746] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.395490] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4ff60fe-3407-42aa-b33c-6254779ad495 in Status: IN_PROGRESS for 2s [ 1172.680079] env[65337]: INFO networking_nsxv3.common.synchronization [req-b3b5fbda-ad1a-4275-8055-31686b145372 req-bb14a015-4036-416c-8e04-40e7dcd1350a tempest-AttachVolumeShelveTestJSON-1101243143 tempest-AttachVolumeShelveTestJSON-1101243143-project-member] Enqueued Resource ID: 7b634dce-1340-436a-a5af-e7d03954de92 with Priority: HIGHEST for action security_group_members [ 1172.680794] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b634dce-1340-436a-a5af-e7d03954de92 with Priority: HIGHEST for action security_group_members [ 1172.681180] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b634dce-1340-436a-a5af-e7d03954de92 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.681941] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b634dce-1340-436a-a5af-e7d03954de92" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.681941] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b634dce-1340-436a-a5af-e7d03954de92" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.681941] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b634dce-1340-436a-a5af-e7d03954de92" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.681941] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.681941] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.682262] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.682262] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.682319] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.682396] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7b634dce-1340-436a-a5af-e7d03954de92',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.863946] env[65337]: INFO networking_nsxv3.common.synchronization [req-93ab6bef-c14c-438f-84d7-daff85828efb req-b87ab4cc-6c4c-49bd-ae9f-990ef4384423 tempest-AttachVolumeTestJSON-1666012690 tempest-AttachVolumeTestJSON-1666012690-project-member] Enqueued Resource ID: 6d469e76-9ef3-431d-9a07-dc20e79dbd4e with Priority: HIGHEST for action security_group_members [ 1172.863946] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d469e76-9ef3-431d-9a07-dc20e79dbd4e with Priority: HIGHEST for action security_group_members [ 1172.864891] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d469e76-9ef3-431d-9a07-dc20e79dbd4e taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.865125] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d469e76-9ef3-431d-9a07-dc20e79dbd4e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.866249] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d469e76-9ef3-431d-9a07-dc20e79dbd4e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.866249] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d469e76-9ef3-431d-9a07-dc20e79dbd4e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.866249] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.866249] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.866249] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.866249] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.866249] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.866249] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d469e76-9ef3-431d-9a07-dc20e79dbd4e',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.175634] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c006a909-f4e1-43d8-bc34-4038d7937297 in Status: SUCCESS [ 1173.175634] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c006a909-f4e1-43d8-bc34-4038d7937297 deletion is rescheduled due to dependency. [ 1173.175634] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c006a909-f4e1-43d8-bc34-4038d7937297" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.185536] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.185699] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.185772] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.186016] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.186128] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.186663] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.187277] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.187277] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.187277] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.187277] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.187277] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b634dce-1340-436a-a5af-e7d03954de92 is going to be updated. [ 1173.218780] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.218780] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.218780] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.218780] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.218780] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.231995] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b634dce-1340-436a-a5af-e7d03954de92 in Status: IN_PROGRESS for 2s [ 1173.240069] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock network-549 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.240069] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "network-549" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.240069] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "network-549" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.240069] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "network-549" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.240069] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.241164] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.241473] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.241808] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.242109] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.243569] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1173.243823] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1173.245636] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1173.245636] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1173.245636] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1173.245636] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1173.245636] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1173.266060] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1173.266277] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1173.266417] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1173.266592] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "network-549" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.266905] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock port-90ad50f6-01ae-4d22-bc50-e78138c3a390 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.267096] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "port-90ad50f6-01ae-4d22-bc50-e78138c3a390" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.267291] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "port-90ad50f6-01ae-4d22-bc50-e78138c3a390" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.267585] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "port-90ad50f6-01ae-4d22-bc50-e78138c3a390" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.267728] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('90ad50f6-01ae-4d22-bc50-e78138c3a390',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.370021] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.370021] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.370021] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.370021] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.370021] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.370311] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.370311] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.370410] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.370895] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.370895] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.371023] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d469e76-9ef3-431d-9a07-dc20e79dbd4e already deleted. [ 1173.371118] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d469e76-9ef3-431d-9a07-dc20e79dbd4e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.748049] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01a2d749-abdf-41c6-bf7b-54833d1bf23e in Status: SUCCESS [ 1173.748049] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01a2d749-abdf-41c6-bf7b-54833d1bf23e deletion is rescheduled due to dependency. [ 1173.748364] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01a2d749-abdf-41c6-bf7b-54833d1bf23e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.770602] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.770888] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.771034] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.771354] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.771554] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.771725] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Segment Port 90ad50f6-01ae-4d22-bc50-e78138c3a390 not found, creating... [ 1173.772009] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.772212] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.772343] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.772663] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.772845] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.773192] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.774028] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.774028] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.774028] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.774028] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.774028] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Resource: SegmentPort with ID: 90ad50f6-01ae-4d22-bc50-e78138c3a390 is going to be created. [ 1173.796529] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.796781] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.796859] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.797150] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.797381] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.797971] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "port-90ad50f6-01ae-4d22-bc50-e78138c3a390" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.408266] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4ff60fe-3407-42aa-b33c-6254779ad495 in Status: SUCCESS [ 1174.408266] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4ff60fe-3407-42aa-b33c-6254779ad495" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.408266] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4ff60fe-3407-42aa-b33c-6254779ad495" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.408266] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4ff60fe-3407-42aa-b33c-6254779ad495" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.408266] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.408266] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.408266] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.408785] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.408785] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.408785] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4ff60fe-3407-42aa-b33c-6254779ad495" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.408785] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d4ff60fe-3407-42aa-b33c-6254779ad495',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.572509] env[65337]: INFO networking_nsxv3.common.synchronization [req-93ab6bef-c14c-438f-84d7-daff85828efb req-a2b5a50a-1448-4efc-beda-a22bca0e5ee1 service nova] Enqueued Resource ID: 6d469e76-9ef3-431d-9a07-dc20e79dbd4e with Priority: HIGHEST for action security_group_rules [ 1174.572509] env[65337]: INFO networking_nsxv3.common.synchronization [req-93ab6bef-c14c-438f-84d7-daff85828efb req-a2b5a50a-1448-4efc-beda-a22bca0e5ee1 service nova] Enqueued Resource ID: 6d469e76-9ef3-431d-9a07-dc20e79dbd4e with Priority: HIGHEST for action security_group_members [ 1174.572509] env[65337]: INFO networking_nsxv3.common.synchronization [req-93ab6bef-c14c-438f-84d7-daff85828efb req-a2b5a50a-1448-4efc-beda-a22bca0e5ee1 service nova] Enqueued Resource ID: 90ad50f6-01ae-4d22-bc50-e78138c3a390 with Priority: HIGHEST for action port [ 1174.575260] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d469e76-9ef3-431d-9a07-dc20e79dbd4e with Priority: HIGHEST for action security_group_rules [ 1174.575260] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d469e76-9ef3-431d-9a07-dc20e79dbd4e with Priority: HIGHEST for action security_group_members [ 1174.575260] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90ad50f6-01ae-4d22-bc50-e78138c3a390 with Priority: HIGHEST for action port [ 1174.576014] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6d469e76-9ef3-431d-9a07-dc20e79dbd4e taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.576903] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6d469e76-9ef3-431d-9a07-dc20e79dbd4e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.576903] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6d469e76-9ef3-431d-9a07-dc20e79dbd4e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.576903] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6d469e76-9ef3-431d-9a07-dc20e79dbd4e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.576903] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6d469e76-9ef3-431d-9a07-dc20e79dbd4e',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.579282] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d469e76-9ef3-431d-9a07-dc20e79dbd4e taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.579481] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d469e76-9ef3-431d-9a07-dc20e79dbd4e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.582339] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d469e76-9ef3-431d-9a07-dc20e79dbd4e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.582709] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d469e76-9ef3-431d-9a07-dc20e79dbd4e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.583011] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.583202] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.583306] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.583564] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.583714] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.583865] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d469e76-9ef3-431d-9a07-dc20e79dbd4e',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.588168] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-90ad50f6-01ae-4d22-bc50-e78138c3a390 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.588168] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-90ad50f6-01ae-4d22-bc50-e78138c3a390" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.588168] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-90ad50f6-01ae-4d22-bc50-e78138c3a390" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.588168] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-90ad50f6-01ae-4d22-bc50-e78138c3a390" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.588168] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('90ad50f6-01ae-4d22-bc50-e78138c3a390',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.912780] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d4ff60fe-3407-42aa-b33c-6254779ad495',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.079719] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d469e76-9ef3-431d-9a07-dc20e79dbd4e taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.079947] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d469e76-9ef3-431d-9a07-dc20e79dbd4e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.090395] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 90ad50f6-01ae-4d22-bc50-e78138c3a390 with status ACTIVE [ 1175.090628] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.090804] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.090943] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.091061] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.091169] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.091389] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.091605] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.091605] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.091736] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.091816] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.092000] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.092158] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.092226] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.092394] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.092481] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.092570] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 90ad50f6-01ae-4d22-bc50-e78138c3a390 is going to be updated. [ 1175.093878] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6d469e76-9ef3-431d-9a07-dc20e79dbd4e',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.116875] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.117171] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.117171] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.117381] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.117521] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.117684] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-90ad50f6-01ae-4d22-bc50-e78138c3a390" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.245308] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b634dce-1340-436a-a5af-e7d03954de92 in Status: SUCCESS [ 1175.245589] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b634dce-1340-436a-a5af-e7d03954de92 deletion is rescheduled due to dependency. [ 1175.245698] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b634dce-1340-436a-a5af-e7d03954de92" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.415064] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d4ff60fe-3407-42aa-b33c-6254779ad495: rpc.has_security_group_logging(os_id): False [ 1175.433389] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.433646] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.433775] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.434116] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.434345] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.434658] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.434810] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.434881] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.435086] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.435176] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.435570] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d4ff60fe-3407-42aa-b33c-6254779ad495 is going to be updated. [ 1175.495936] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.496231] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.496312] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.496571] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.496746] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.516231] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d4ff60fe-3407-42aa-b33c-6254779ad495 in Status: IN_PROGRESS for 2s [ 1175.596044] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6d469e76-9ef3-431d-9a07-dc20e79dbd4e',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.098425] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.098640] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.098768] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.099043] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.099144] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.099242] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d469e76-9ef3-431d-9a07-dc20e79dbd4e is going to be created. [ 1176.122812] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.123027] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.123113] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.123391] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.123593] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.133448] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d469e76-9ef3-431d-9a07-dc20e79dbd4e in Status: UNINITIALIZED for 2s [ 1177.533718] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d4ff60fe-3407-42aa-b33c-6254779ad495 in Status: SUCCESS [ 1177.534121] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d4ff60fe-3407-42aa-b33c-6254779ad495" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.144753] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d469e76-9ef3-431d-9a07-dc20e79dbd4e in Status: SUCCESS [ 1178.144991] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d469e76-9ef3-431d-9a07-dc20e79dbd4e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.145183] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d469e76-9ef3-431d-9a07-dc20e79dbd4e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.145411] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d469e76-9ef3-431d-9a07-dc20e79dbd4e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.145609] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.145727] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.145795] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.146055] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.146055] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.146127] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d469e76-9ef3-431d-9a07-dc20e79dbd4e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.146245] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6d469e76-9ef3-431d-9a07-dc20e79dbd4e',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.649225] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6d469e76-9ef3-431d-9a07-dc20e79dbd4e',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.222222] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6d469e76-9ef3-431d-9a07-dc20e79dbd4e: rpc.has_security_group_logging(os_id): False [ 1179.239036] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.239193] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.239236] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.239520] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.239520] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.239822] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.239985] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.239985] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.240224] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.240321] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.240491] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6d469e76-9ef3-431d-9a07-dc20e79dbd4e is going to be created. [ 1179.313677] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.313677] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.313677] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.313908] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.313908] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.331899] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6d469e76-9ef3-431d-9a07-dc20e79dbd4e in Status: IN_PROGRESS for 2s [ 1179.576719] env[65337]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1179.576719] env[65337]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1180.895807] env[65337]: INFO networking_nsxv3.common.synchronization [None req-b4b8bc74-137d-433b-83ac-fd6c3f1f338f tempest-AttachVolumeShelveTestJSON-1101243143 tempest-AttachVolumeShelveTestJSON-1101243143-project-member] Enqueued Resource ID: a64509fd-193d-41f5-8257-21afcd1d96a2 with Priority: HIGHEST for action security_group_rules [ 1180.897132] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a64509fd-193d-41f5-8257-21afcd1d96a2 with Priority: HIGHEST for action security_group_rules [ 1180.897551] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a64509fd-193d-41f5-8257-21afcd1d96a2 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.897704] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a64509fd-193d-41f5-8257-21afcd1d96a2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.897787] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a64509fd-193d-41f5-8257-21afcd1d96a2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.898301] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a64509fd-193d-41f5-8257-21afcd1d96a2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.898408] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a64509fd-193d-41f5-8257-21afcd1d96a2',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.988223] env[65337]: INFO networking_nsxv3.common.synchronization [None req-577392e1-6c43-493c-b1ac-e1fd66e179e2 tempest-AttachVolumeShelveTestJSON-1101243143 tempest-AttachVolumeShelveTestJSON-1101243143-project-member] Enqueued Resource ID: a64509fd-193d-41f5-8257-21afcd1d96a2 with Priority: HIGHEST for action security_group_rules [ 1180.988725] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a64509fd-193d-41f5-8257-21afcd1d96a2 with Priority: HIGHEST for action security_group_rules [ 1180.989051] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a64509fd-193d-41f5-8257-21afcd1d96a2 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.989159] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a64509fd-193d-41f5-8257-21afcd1d96a2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.349675] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6d469e76-9ef3-431d-9a07-dc20e79dbd4e in Status: SUCCESS [ 1181.349951] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6d469e76-9ef3-431d-9a07-dc20e79dbd4e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.419828] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.419828] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.419828] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.420036] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.420149] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.420205] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a64509fd-193d-41f5-8257-21afcd1d96a2 already deleted. [ 1181.420286] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a64509fd-193d-41f5-8257-21afcd1d96a2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.420435] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a64509fd-193d-41f5-8257-21afcd1d96a2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.420621] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a64509fd-193d-41f5-8257-21afcd1d96a2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.420700] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a64509fd-193d-41f5-8257-21afcd1d96a2',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.943753] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.944085] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.944085] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.944249] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.944479] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.944479] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a64509fd-193d-41f5-8257-21afcd1d96a2 already deleted. [ 1181.944627] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a64509fd-193d-41f5-8257-21afcd1d96a2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.050158] env[65337]: INFO networking_nsxv3.common.synchronization [None req-dc10d1d3-3acf-4e72-916c-d31fc27f667e None None] Enqueued Resource ID: 3e6effcd-e677-4f90-96b6-702ef299d170 with Priority: HIGHEST for action port [ 1182.050158] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e6effcd-e677-4f90-96b6-702ef299d170 with Priority: HIGHEST for action port [ 1182.050158] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-3e6effcd-e677-4f90-96b6-702ef299d170 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.050834] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3e6effcd-e677-4f90-96b6-702ef299d170" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.050834] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3e6effcd-e677-4f90-96b6-702ef299d170" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.050834] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3e6effcd-e677-4f90-96b6-702ef299d170" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.050834] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e6effcd-e677-4f90-96b6-702ef299d170',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.553280] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3e6effcd-e677-4f90-96b6-702ef299d170 [ 1182.553482] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.553637] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.553711] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.553956] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.553992] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.555737] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3e6effcd-e677-4f90-96b6-702ef299d170 already deleted. [ 1182.555846] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3e6effcd-e677-4f90-96b6-702ef299d170" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.893645] env[65337]: INFO networking_nsxv3.common.synchronization [None req-efaa294e-9320-4bfa-addc-4fd5da3b3e9d tempest-AttachVolumeNegativeTest-935303807 tempest-AttachVolumeNegativeTest-935303807-project-member] Enqueued Resource ID: 7fa9655b-7006-421a-adab-fda9e0c1520c with Priority: HIGHEST for action security_group_rules [ 1182.894257] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fa9655b-7006-421a-adab-fda9e0c1520c with Priority: HIGHEST for action security_group_rules [ 1182.894562] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7fa9655b-7006-421a-adab-fda9e0c1520c taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.894692] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7fa9655b-7006-421a-adab-fda9e0c1520c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.894751] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7fa9655b-7006-421a-adab-fda9e0c1520c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.895016] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7fa9655b-7006-421a-adab-fda9e0c1520c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.895125] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7fa9655b-7006-421a-adab-fda9e0c1520c',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.999980] env[65337]: INFO networking_nsxv3.common.synchronization [None req-66548b1b-a74d-4581-8173-a864fa12f95a tempest-AttachVolumeNegativeTest-935303807 tempest-AttachVolumeNegativeTest-935303807-project-member] Enqueued Resource ID: 7fa9655b-7006-421a-adab-fda9e0c1520c with Priority: HIGHEST for action security_group_rules [ 1183.000609] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fa9655b-7006-421a-adab-fda9e0c1520c with Priority: HIGHEST for action security_group_rules [ 1183.000928] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7fa9655b-7006-421a-adab-fda9e0c1520c taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.001056] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7fa9655b-7006-421a-adab-fda9e0c1520c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.414440] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.414660] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.414722] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.414926] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.415042] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.415147] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7fa9655b-7006-421a-adab-fda9e0c1520c already deleted. [ 1183.415237] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7fa9655b-7006-421a-adab-fda9e0c1520c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.415624] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7fa9655b-7006-421a-adab-fda9e0c1520c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.415624] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7fa9655b-7006-421a-adab-fda9e0c1520c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.415843] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7fa9655b-7006-421a-adab-fda9e0c1520c',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.819721] env[65337]: INFO networking_nsxv3.common.synchronization [req-7d27045f-a6b9-4e5d-ab32-265fa44b0cb8 req-29b7bcde-3975-45d2-bff1-2a4d987707a8 tempest-MultipleCreateTestJSON-392767123 tempest-MultipleCreateTestJSON-392767123-project-member] Enqueued Resource ID: 01a2d749-abdf-41c6-bf7b-54833d1bf23e with Priority: HIGHEST for action security_group_members [ 1183.820327] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01a2d749-abdf-41c6-bf7b-54833d1bf23e with Priority: HIGHEST for action security_group_members [ 1183.820632] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-01a2d749-abdf-41c6-bf7b-54833d1bf23e taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.820783] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01a2d749-abdf-41c6-bf7b-54833d1bf23e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.820856] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01a2d749-abdf-41c6-bf7b-54833d1bf23e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.823695] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01a2d749-abdf-41c6-bf7b-54833d1bf23e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.823695] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.823695] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.823695] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.823695] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.823695] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.823695] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('01a2d749-abdf-41c6-bf7b-54833d1bf23e',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.939177] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.939323] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.939399] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.939802] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.940782] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.940782] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7fa9655b-7006-421a-adab-fda9e0c1520c already deleted. [ 1183.940782] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7fa9655b-7006-421a-adab-fda9e0c1520c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.210330] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock network-686 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.210628] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "network-686" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.210740] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "network-686" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.212655] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "network-686" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.213307] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.213531] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.213677] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.213963] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.215274] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.215274] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1184.215274] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1184.215274] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1184.215274] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1184.215274] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1184.215274] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1184.215577] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1184.231794] env[65337]: INFO networking_nsxv3.common.synchronization [None req-9d8b0364-fead-4295-b015-4f9d3c0e1523 None None] Enqueued Resource ID: cb1f12a0-916f-4d1f-9f57-76cb591bdb2f with Priority: HIGHEST for action port [ 1184.232930] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb1f12a0-916f-4d1f-9f57-76cb591bdb2f with Priority: HIGHEST for action port [ 1184.235584] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-cb1f12a0-916f-4d1f-9f57-76cb591bdb2f taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.235584] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cb1f12a0-916f-4d1f-9f57-76cb591bdb2f" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.235584] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cb1f12a0-916f-4d1f-9f57-76cb591bdb2f" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.235584] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cb1f12a0-916f-4d1f-9f57-76cb591bdb2f" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.235584] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cb1f12a0-916f-4d1f-9f57-76cb591bdb2f',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.249024] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1184.249024] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1184.249024] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1184.249024] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "network-686" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.249024] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock port-06633a0c-0c3b-46cc-8a07-b5c8ed4ec6c9 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.249024] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "port-06633a0c-0c3b-46cc-8a07-b5c8ed4ec6c9" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.249024] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "port-06633a0c-0c3b-46cc-8a07-b5c8ed4ec6c9" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.249024] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "port-06633a0c-0c3b-46cc-8a07-b5c8ed4ec6c9" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.249024] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('06633a0c-0c3b-46cc-8a07-b5c8ed4ec6c9',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.324979] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.325438] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.325574] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.325841] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.325970] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.326263] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.326438] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.326540] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.326723] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.326867] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.327033] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01a2d749-abdf-41c6-bf7b-54833d1bf23e is going to be updated. [ 1184.361267] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.361482] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.361482] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.361584] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.361900] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.372077] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01a2d749-abdf-41c6-bf7b-54833d1bf23e in Status: IN_PROGRESS for 2s [ 1184.737257] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cb1f12a0-916f-4d1f-9f57-76cb591bdb2f [ 1184.737651] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.737727] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.737762] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.737988] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.738125] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.738243] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cb1f12a0-916f-4d1f-9f57-76cb591bdb2f already deleted. [ 1184.738325] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cb1f12a0-916f-4d1f-9f57-76cb591bdb2f" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.754890] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.755139] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.755267] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.755611] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.755687] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.755838] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Segment Port 06633a0c-0c3b-46cc-8a07-b5c8ed4ec6c9 not found, creating... [ 1184.756114] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.756341] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.756475] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.756699] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.756837] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.757139] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.757392] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.757525] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.757731] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.757862] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.758184] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Resource: SegmentPort with ID: 06633a0c-0c3b-46cc-8a07-b5c8ed4ec6c9 is going to be created. [ 1184.780050] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.780277] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.780381] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.780642] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.780863] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.781086] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "port-06633a0c-0c3b-46cc-8a07-b5c8ed4ec6c9" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.988239] env[65337]: INFO networking_nsxv3.common.synchronization [req-8c4e634c-b710-459c-b82a-5301503ede10 req-6c4ca5c3-d91c-4e20-ad88-4bd5e8829abf tempest-ServerActionsTestJSON-704073373 tempest-ServerActionsTestJSON-704073373-project-member] Enqueued Resource ID: 2ad13511-d648-4224-8e48-ddf1ab1b8013 with Priority: HIGHEST for action security_group_members [ 1184.988652] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ad13511-d648-4224-8e48-ddf1ab1b8013 with Priority: HIGHEST for action security_group_members [ 1184.988990] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ad13511-d648-4224-8e48-ddf1ab1b8013 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.989144] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ad13511-d648-4224-8e48-ddf1ab1b8013" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.989210] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ad13511-d648-4224-8e48-ddf1ab1b8013" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.989426] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ad13511-d648-4224-8e48-ddf1ab1b8013" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.989585] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.989697] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.989752] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.989921] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.989994] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.990125] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2ad13511-d648-4224-8e48-ddf1ab1b8013',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.493291] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.493291] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.493291] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.493821] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.494053] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.495105] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.495105] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.495105] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.496825] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.496825] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.496825] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ad13511-d648-4224-8e48-ddf1ab1b8013 is going to be updated. [ 1185.498602] env[65337]: INFO networking_nsxv3.common.synchronization [req-7d27045f-a6b9-4e5d-ab32-265fa44b0cb8 req-18e64741-a4ab-4b6d-b06e-95a35dcd89ed service nova] Enqueued Resource ID: 01a2d749-abdf-41c6-bf7b-54833d1bf23e with Priority: HIGHEST for action security_group_rules [ 1185.498992] env[65337]: INFO networking_nsxv3.common.synchronization [req-7d27045f-a6b9-4e5d-ab32-265fa44b0cb8 req-18e64741-a4ab-4b6d-b06e-95a35dcd89ed service nova] Enqueued Resource ID: 01a2d749-abdf-41c6-bf7b-54833d1bf23e with Priority: HIGHEST for action security_group_members [ 1185.499345] env[65337]: INFO networking_nsxv3.common.synchronization [req-7d27045f-a6b9-4e5d-ab32-265fa44b0cb8 req-18e64741-a4ab-4b6d-b06e-95a35dcd89ed service nova] Enqueued Resource ID: 06633a0c-0c3b-46cc-8a07-b5c8ed4ec6c9 with Priority: HIGHEST for action port [ 1185.500370] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01a2d749-abdf-41c6-bf7b-54833d1bf23e with Priority: HIGHEST for action security_group_rules [ 1185.500697] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01a2d749-abdf-41c6-bf7b-54833d1bf23e with Priority: HIGHEST for action security_group_members [ 1185.500906] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06633a0c-0c3b-46cc-8a07-b5c8ed4ec6c9 with Priority: HIGHEST for action port [ 1185.501268] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-01a2d749-abdf-41c6-bf7b-54833d1bf23e taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.501505] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-01a2d749-abdf-41c6-bf7b-54833d1bf23e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.501648] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-01a2d749-abdf-41c6-bf7b-54833d1bf23e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.501901] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-01a2d749-abdf-41c6-bf7b-54833d1bf23e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.502879] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('01a2d749-abdf-41c6-bf7b-54833d1bf23e',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.503280] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-01a2d749-abdf-41c6-bf7b-54833d1bf23e taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.503480] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01a2d749-abdf-41c6-bf7b-54833d1bf23e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.504164] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-06633a0c-0c3b-46cc-8a07-b5c8ed4ec6c9 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.504411] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-06633a0c-0c3b-46cc-8a07-b5c8ed4ec6c9" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.504578] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-06633a0c-0c3b-46cc-8a07-b5c8ed4ec6c9" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.505022] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-06633a0c-0c3b-46cc-8a07-b5c8ed4ec6c9" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.505022] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('06633a0c-0c3b-46cc-8a07-b5c8ed4ec6c9',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.529020] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.529020] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.529020] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.529020] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.529020] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.539997] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ad13511-d648-4224-8e48-ddf1ab1b8013 in Status: IN_PROGRESS for 2s [ 1185.742384] env[65337]: INFO networking_nsxv3.common.synchronization [req-7d27045f-a6b9-4e5d-ab32-265fa44b0cb8 req-1ccba257-9b37-4647-9f8a-3a04c9011f22 tempest-MultipleCreateTestJSON-392767123 tempest-MultipleCreateTestJSON-392767123-project-member] Enqueued Resource ID: 01a2d749-abdf-41c6-bf7b-54833d1bf23e with Priority: HIGHEST for action security_group_members [ 1185.742384] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01a2d749-abdf-41c6-bf7b-54833d1bf23e with Priority: HIGHEST for action security_group_members [ 1185.743434] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-01a2d749-abdf-41c6-bf7b-54833d1bf23e taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.743709] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01a2d749-abdf-41c6-bf7b-54833d1bf23e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.007136] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-01a2d749-abdf-41c6-bf7b-54833d1bf23e taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.007476] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01a2d749-abdf-41c6-bf7b-54833d1bf23e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.007476] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 06633a0c-0c3b-46cc-8a07-b5c8ed4ec6c9 with status ACTIVE [ 1186.007600] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.007909] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.007909] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.008199] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.008199] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.008353] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.008353] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.008604] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.008604] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.008732] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.009304] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.009304] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.009304] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.009304] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.009304] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.009304] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 06633a0c-0c3b-46cc-8a07-b5c8ed4ec6c9 is going to be updated. [ 1186.034405] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.034578] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.034631] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.034843] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.034989] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.035162] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-06633a0c-0c3b-46cc-8a07-b5c8ed4ec6c9" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.073379] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock network-686 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.073572] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "network-686" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.073694] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "network-686" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.073951] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "network-686" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.074358] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.074570] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.074728] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.074972] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.075139] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.075358] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1186.075468] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1186.075577] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1186.075684] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1186.075790] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1186.075892] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1186.076058] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1186.097965] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1186.098183] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1186.098285] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1186.098461] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "network-686" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.098872] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock port-8316782f-3b0a-4b22-a6c1-7deaa68a0ce1 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.098995] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "port-8316782f-3b0a-4b22-a6c1-7deaa68a0ce1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.099129] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "port-8316782f-3b0a-4b22-a6c1-7deaa68a0ce1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.099455] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "port-8316782f-3b0a-4b22-a6c1-7deaa68a0ce1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.099599] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8316782f-3b0a-4b22-a6c1-7deaa68a0ce1',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.383018] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01a2d749-abdf-41c6-bf7b-54833d1bf23e in Status: SUCCESS [ 1186.383233] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01a2d749-abdf-41c6-bf7b-54833d1bf23e deletion is rescheduled due to dependency. [ 1186.383303] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01a2d749-abdf-41c6-bf7b-54833d1bf23e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.383467] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01a2d749-abdf-41c6-bf7b-54833d1bf23e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.383686] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01a2d749-abdf-41c6-bf7b-54833d1bf23e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.384256] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.384256] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.384256] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.384256] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.384455] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.384455] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('01a2d749-abdf-41c6-bf7b-54833d1bf23e',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.602496] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.602842] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.602960] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.603259] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.603451] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.603633] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Segment Port 8316782f-3b0a-4b22-a6c1-7deaa68a0ce1 not found, creating... [ 1186.603930] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.604116] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.604252] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.604527] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.604632] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.604921] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.605203] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.605378] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.605710] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.605934] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.606167] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Resource: SegmentPort with ID: 8316782f-3b0a-4b22-a6c1-7deaa68a0ce1 is going to be created. [ 1186.635300] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.635549] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.635677] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.636051] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.636626] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.636909] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "port-8316782f-3b0a-4b22-a6c1-7deaa68a0ce1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.888073] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('01a2d749-abdf-41c6-bf7b-54833d1bf23e',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.353174] env[65337]: INFO networking_nsxv3.common.synchronization [req-7d27045f-a6b9-4e5d-ab32-265fa44b0cb8 req-3823fd12-f65c-4592-b383-beacf3ab5c59 service nova] Enqueued Resource ID: 01a2d749-abdf-41c6-bf7b-54833d1bf23e with Priority: HIGHEST for action security_group_rules [ 1187.355354] env[65337]: INFO networking_nsxv3.common.synchronization [req-7d27045f-a6b9-4e5d-ab32-265fa44b0cb8 req-3823fd12-f65c-4592-b383-beacf3ab5c59 service nova] Enqueued Resource ID: 01a2d749-abdf-41c6-bf7b-54833d1bf23e with Priority: HIGHEST for action security_group_members [ 1187.355354] env[65337]: INFO networking_nsxv3.common.synchronization [req-7d27045f-a6b9-4e5d-ab32-265fa44b0cb8 req-3823fd12-f65c-4592-b383-beacf3ab5c59 service nova] Enqueued Resource ID: 8316782f-3b0a-4b22-a6c1-7deaa68a0ce1 with Priority: HIGHEST for action port [ 1187.355354] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01a2d749-abdf-41c6-bf7b-54833d1bf23e with Priority: HIGHEST for action security_group_rules [ 1187.355354] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01a2d749-abdf-41c6-bf7b-54833d1bf23e with Priority: HIGHEST for action security_group_members [ 1187.355354] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8316782f-3b0a-4b22-a6c1-7deaa68a0ce1 with Priority: HIGHEST for action port [ 1187.355354] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-01a2d749-abdf-41c6-bf7b-54833d1bf23e taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.355354] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-01a2d749-abdf-41c6-bf7b-54833d1bf23e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.355877] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-01a2d749-abdf-41c6-bf7b-54833d1bf23e taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.355877] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01a2d749-abdf-41c6-bf7b-54833d1bf23e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.356077] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-8316782f-3b0a-4b22-a6c1-7deaa68a0ce1 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.356204] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8316782f-3b0a-4b22-a6c1-7deaa68a0ce1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.356325] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8316782f-3b0a-4b22-a6c1-7deaa68a0ce1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.356623] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8316782f-3b0a-4b22-a6c1-7deaa68a0ce1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.356743] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8316782f-3b0a-4b22-a6c1-7deaa68a0ce1',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.389798] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('01a2d749-abdf-41c6-bf7b-54833d1bf23e',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.549129] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ad13511-d648-4224-8e48-ddf1ab1b8013 in Status: SUCCESS [ 1187.549411] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ad13511-d648-4224-8e48-ddf1ab1b8013 deletion is rescheduled due to dependency. [ 1187.549552] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ad13511-d648-4224-8e48-ddf1ab1b8013" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.859438] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8316782f-3b0a-4b22-a6c1-7deaa68a0ce1 with status ACTIVE [ 1187.859438] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.859438] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.859438] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.859856] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.859856] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.860704] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.860704] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.860704] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.860704] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.860704] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.860704] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.860704] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.860704] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.861156] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.861156] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.861156] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8316782f-3b0a-4b22-a6c1-7deaa68a0ce1 is going to be updated. [ 1187.883726] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.883883] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.883959] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.884194] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.884350] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.884518] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8316782f-3b0a-4b22-a6c1-7deaa68a0ce1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.892102] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.892264] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.892373] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.892608] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.892698] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.892795] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01a2d749-abdf-41c6-bf7b-54833d1bf23e is going to be updated. [ 1187.930193] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.930397] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.930397] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.930613] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.930770] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.943598] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01a2d749-abdf-41c6-bf7b-54833d1bf23e in Status: IN_PROGRESS for 2s [ 1188.023378] env[65337]: INFO networking_nsxv3.common.synchronization [req-12053ae5-3456-4f2b-8bef-9edae78f1cc5 req-b052924e-a793-403a-83f4-45346cc67159 tempest-ServerActionsTestOtherB-648353996 tempest-ServerActionsTestOtherB-648353996-project-member] Enqueued Resource ID: d4ff60fe-3407-42aa-b33c-6254779ad495 with Priority: HIGHEST for action security_group_members [ 1188.024268] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4ff60fe-3407-42aa-b33c-6254779ad495 with Priority: HIGHEST for action security_group_members [ 1188.024563] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4ff60fe-3407-42aa-b33c-6254779ad495 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.024694] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4ff60fe-3407-42aa-b33c-6254779ad495" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.024763] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4ff60fe-3407-42aa-b33c-6254779ad495" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.025082] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4ff60fe-3407-42aa-b33c-6254779ad495" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.025248] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.025421] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.025489] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.025668] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.025880] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.026023] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d4ff60fe-3407-42aa-b33c-6254779ad495',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.523027] env[65337]: INFO networking_nsxv3.common.synchronization [req-d14f2427-01e0-42e1-a1a0-3522a0176f63 req-d2c38f74-7180-46c7-b974-99a3fd1df27f tempest-AttachVolumeShelveTestJSON-1101243143 tempest-AttachVolumeShelveTestJSON-1101243143-project-member] Enqueued Resource ID: a64509fd-193d-41f5-8257-21afcd1d96a2 with Priority: HIGHEST for action security_group_members [ 1188.527902] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a64509fd-193d-41f5-8257-21afcd1d96a2 with Priority: HIGHEST for action security_group_members [ 1188.527902] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-a64509fd-193d-41f5-8257-21afcd1d96a2 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.527902] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a64509fd-193d-41f5-8257-21afcd1d96a2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.527902] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a64509fd-193d-41f5-8257-21afcd1d96a2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.528352] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a64509fd-193d-41f5-8257-21afcd1d96a2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.528488] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.529215] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.529215] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.529215] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.529215] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.529215] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a64509fd-193d-41f5-8257-21afcd1d96a2',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.530282] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.530397] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.530500] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.530669] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.530754] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.530976] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.531126] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.531210] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.531389] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.531496] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.531606] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d4ff60fe-3407-42aa-b33c-6254779ad495 is going to be updated. [ 1188.561881] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.562093] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.562138] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.562321] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.562461] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.573047] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4ff60fe-3407-42aa-b33c-6254779ad495 in Status: IN_PROGRESS for 2s [ 1188.843945] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock network-981 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.844148] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "network-981" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.844268] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "network-981" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.844526] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "network-981" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.844774] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.844920] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.845046] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.845356] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.845397] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.845584] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1188.846715] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1188.846715] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1188.846715] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1188.846715] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1188.846715] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1188.846715] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1188.864899] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1188.865155] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1188.865206] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1188.865379] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "network-981" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.865699] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock port-8e3fb8a8-6dc5-4513-afec-07866c295ec8 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.865869] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "port-8e3fb8a8-6dc5-4513-afec-07866c295ec8" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.865984] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "port-8e3fb8a8-6dc5-4513-afec-07866c295ec8" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.866429] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "port-8e3fb8a8-6dc5-4513-afec-07866c295ec8" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.866571] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8e3fb8a8-6dc5-4513-afec-07866c295ec8',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.033692] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.033866] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.034078] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.034210] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.034304] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.034589] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.034653] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.034697] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.034850] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.034923] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.035023] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a64509fd-193d-41f5-8257-21afcd1d96a2 already deleted. [ 1189.035105] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a64509fd-193d-41f5-8257-21afcd1d96a2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.370494] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.370861] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.371066] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.371466] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.371782] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.371943] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Segment Port 8e3fb8a8-6dc5-4513-afec-07866c295ec8 not found, creating... [ 1189.372326] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.372544] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.372733] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.373055] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.373238] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.373537] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.373766] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.373962] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.374284] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.374450] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.374658] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Resource: SegmentPort with ID: 8e3fb8a8-6dc5-4513-afec-07866c295ec8 is going to be created. [ 1189.398159] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.398382] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.398507] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.398788] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.399027] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.399281] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "port-8e3fb8a8-6dc5-4513-afec-07866c295ec8" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.025582] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01a2d749-abdf-41c6-bf7b-54833d1bf23e in Status: SUCCESS [ 1190.025905] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01a2d749-abdf-41c6-bf7b-54833d1bf23e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.025905] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01a2d749-abdf-41c6-bf7b-54833d1bf23e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.026203] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01a2d749-abdf-41c6-bf7b-54833d1bf23e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.026485] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.026696] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.026783] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.027047] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.027142] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.027246] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('01a2d749-abdf-41c6-bf7b-54833d1bf23e',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.115571] env[65337]: INFO networking_nsxv3.common.synchronization [req-d14f2427-01e0-42e1-a1a0-3522a0176f63 req-5b420f4e-4f62-4fbe-9900-879f6e4dcd48 service nova] Enqueued Resource ID: a64509fd-193d-41f5-8257-21afcd1d96a2 with Priority: HIGHEST for action security_group_rules [ 1190.115845] env[65337]: INFO networking_nsxv3.common.synchronization [req-d14f2427-01e0-42e1-a1a0-3522a0176f63 req-5b420f4e-4f62-4fbe-9900-879f6e4dcd48 service nova] Enqueued Resource ID: a64509fd-193d-41f5-8257-21afcd1d96a2 with Priority: HIGHEST for action security_group_members [ 1190.115979] env[65337]: INFO networking_nsxv3.common.synchronization [req-d14f2427-01e0-42e1-a1a0-3522a0176f63 req-5b420f4e-4f62-4fbe-9900-879f6e4dcd48 service nova] Enqueued Resource ID: 8e3fb8a8-6dc5-4513-afec-07866c295ec8 with Priority: HIGHEST for action port [ 1190.116630] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a64509fd-193d-41f5-8257-21afcd1d96a2 with Priority: HIGHEST for action security_group_rules [ 1190.116868] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a64509fd-193d-41f5-8257-21afcd1d96a2 with Priority: HIGHEST for action security_group_members [ 1190.116984] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e3fb8a8-6dc5-4513-afec-07866c295ec8 with Priority: HIGHEST for action port [ 1190.117444] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a64509fd-193d-41f5-8257-21afcd1d96a2 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.117686] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a64509fd-193d-41f5-8257-21afcd1d96a2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.118203] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a64509fd-193d-41f5-8257-21afcd1d96a2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.118203] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a64509fd-193d-41f5-8257-21afcd1d96a2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.118374] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a64509fd-193d-41f5-8257-21afcd1d96a2',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.119470] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-a64509fd-193d-41f5-8257-21afcd1d96a2 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.119668] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a64509fd-193d-41f5-8257-21afcd1d96a2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.119812] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a64509fd-193d-41f5-8257-21afcd1d96a2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.120136] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a64509fd-193d-41f5-8257-21afcd1d96a2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.120442] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.120678] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.120847] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.121481] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.121481] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.121481] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a64509fd-193d-41f5-8257-21afcd1d96a2',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.122303] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-8e3fb8a8-6dc5-4513-afec-07866c295ec8 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.122752] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8e3fb8a8-6dc5-4513-afec-07866c295ec8" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.122971] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8e3fb8a8-6dc5-4513-afec-07866c295ec8" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.123405] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8e3fb8a8-6dc5-4513-afec-07866c295ec8" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.123405] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8e3fb8a8-6dc5-4513-afec-07866c295ec8',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.530069] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('01a2d749-abdf-41c6-bf7b-54833d1bf23e',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.583280] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4ff60fe-3407-42aa-b33c-6254779ad495 in Status: SUCCESS [ 1190.583560] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d4ff60fe-3407-42aa-b33c-6254779ad495 deletion is rescheduled due to dependency. [ 1190.583712] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4ff60fe-3407-42aa-b33c-6254779ad495" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.625673] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a64509fd-193d-41f5-8257-21afcd1d96a2',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.626998] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-a64509fd-193d-41f5-8257-21afcd1d96a2 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.627146] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a64509fd-193d-41f5-8257-21afcd1d96a2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.627624] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8e3fb8a8-6dc5-4513-afec-07866c295ec8 with status ACTIVE [ 1190.627821] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.627926] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.628025] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.628338] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.628427] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.628605] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.628834] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.628834] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.628982] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.629029] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.629216] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.629328] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.629392] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.629536] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.629628] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.629728] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8e3fb8a8-6dc5-4513-afec-07866c295ec8 is going to be updated. [ 1190.653319] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.653538] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.653703] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.654013] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.654203] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.654527] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8e3fb8a8-6dc5-4513-afec-07866c295ec8" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.880184] env[65337]: INFO networking_nsxv3.common.synchronization [req-694c2e96-f60f-48ef-a1fb-275025725205 req-7a3ce2ec-23d7-4199-a1c8-dc2d9d049e36 tempest-AttachVolumeNegativeTest-935303807 tempest-AttachVolumeNegativeTest-935303807-project-member] Enqueued Resource ID: 7fa9655b-7006-421a-adab-fda9e0c1520c with Priority: HIGHEST for action security_group_members [ 1190.880885] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fa9655b-7006-421a-adab-fda9e0c1520c with Priority: HIGHEST for action security_group_members [ 1190.881333] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fa9655b-7006-421a-adab-fda9e0c1520c taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.881503] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fa9655b-7006-421a-adab-fda9e0c1520c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.881644] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fa9655b-7006-421a-adab-fda9e0c1520c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.881931] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fa9655b-7006-421a-adab-fda9e0c1520c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.882266] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.882434] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.882562] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.882699] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.882831] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.882910] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fa9655b-7006-421a-adab-fda9e0c1520c',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.032331] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('01a2d749-abdf-41c6-bf7b-54833d1bf23e',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.128213] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a64509fd-193d-41f5-8257-21afcd1d96a2',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.273802] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock network-61 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.273802] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "network-61" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.273986] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "network-61" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.274423] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "network-61" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.274717] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.274942] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.275156] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.275428] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.275627] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.275883] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1191.276054] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1191.276208] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1191.276360] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1191.276536] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1191.276656] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1191.276789] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1191.300439] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1191.300619] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1191.300760] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1191.301091] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "network-61" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.301304] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock port-9ec54bed-5924-49f9-bb49-3d399770ccbe taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.301484] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "port-9ec54bed-5924-49f9-bb49-3d399770ccbe" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.301628] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "port-9ec54bed-5924-49f9-bb49-3d399770ccbe" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.303133] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "port-9ec54bed-5924-49f9-bb49-3d399770ccbe" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.303375] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9ec54bed-5924-49f9-bb49-3d399770ccbe',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.385676] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.386700] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.386700] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.386700] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.386700] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.386976] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.387191] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.387307] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.387564] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.387700] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.387843] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fa9655b-7006-421a-adab-fda9e0c1520c already deleted. [ 1191.387980] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fa9655b-7006-421a-adab-fda9e0c1520c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.535827] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.535827] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.535827] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.535827] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.536149] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.536149] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01a2d749-abdf-41c6-bf7b-54833d1bf23e is going to be updated. [ 1191.565638] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.565841] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.565841] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.566042] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.566196] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.575320] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01a2d749-abdf-41c6-bf7b-54833d1bf23e in Status: IN_PROGRESS for 2s [ 1191.633488] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.633665] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.633737] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.633955] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.634059] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.634160] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a64509fd-193d-41f5-8257-21afcd1d96a2 is going to be created. [ 1191.660927] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.661221] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.661221] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.661373] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.661854] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.671753] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a64509fd-193d-41f5-8257-21afcd1d96a2 in Status: UNINITIALIZED for 2s [ 1191.806873] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.807323] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.807601] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.808100] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.808372] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.808682] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Segment Port 9ec54bed-5924-49f9-bb49-3d399770ccbe not found, creating... [ 1191.809239] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.809564] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.809809] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.810281] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.810529] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.811080] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.811368] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.811600] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.811945] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.812224] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.812732] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Resource: SegmentPort with ID: 9ec54bed-5924-49f9-bb49-3d399770ccbe is going to be created. [ 1191.848088] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.848756] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.848756] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.849096] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.849568] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.850026] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "port-9ec54bed-5924-49f9-bb49-3d399770ccbe" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.591132] env[65337]: INFO networking_nsxv3.common.synchronization [req-694c2e96-f60f-48ef-a1fb-275025725205 req-3657d2f1-34cc-4f90-9514-63b5febe77d1 service nova] Enqueued Resource ID: 7fa9655b-7006-421a-adab-fda9e0c1520c with Priority: HIGHEST for action security_group_rules [ 1192.591408] env[65337]: INFO networking_nsxv3.common.synchronization [req-694c2e96-f60f-48ef-a1fb-275025725205 req-3657d2f1-34cc-4f90-9514-63b5febe77d1 service nova] Enqueued Resource ID: 7fa9655b-7006-421a-adab-fda9e0c1520c with Priority: HIGHEST for action security_group_members [ 1192.591564] env[65337]: INFO networking_nsxv3.common.synchronization [req-694c2e96-f60f-48ef-a1fb-275025725205 req-3657d2f1-34cc-4f90-9514-63b5febe77d1 service nova] Enqueued Resource ID: 9ec54bed-5924-49f9-bb49-3d399770ccbe with Priority: HIGHEST for action port [ 1192.592412] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fa9655b-7006-421a-adab-fda9e0c1520c with Priority: HIGHEST for action security_group_rules [ 1192.592566] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fa9655b-7006-421a-adab-fda9e0c1520c with Priority: HIGHEST for action security_group_members [ 1192.592886] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ec54bed-5924-49f9-bb49-3d399770ccbe with Priority: HIGHEST for action port [ 1192.593072] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7fa9655b-7006-421a-adab-fda9e0c1520c taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.593211] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7fa9655b-7006-421a-adab-fda9e0c1520c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.593293] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7fa9655b-7006-421a-adab-fda9e0c1520c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.593472] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7fa9655b-7006-421a-adab-fda9e0c1520c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.593556] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7fa9655b-7006-421a-adab-fda9e0c1520c',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.595381] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fa9655b-7006-421a-adab-fda9e0c1520c taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.595522] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fa9655b-7006-421a-adab-fda9e0c1520c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.595592] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fa9655b-7006-421a-adab-fda9e0c1520c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.595804] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fa9655b-7006-421a-adab-fda9e0c1520c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.595992] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.596118] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.596180] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.596388] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.596474] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.596799] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fa9655b-7006-421a-adab-fda9e0c1520c',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.597522] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-9ec54bed-5924-49f9-bb49-3d399770ccbe taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.597627] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9ec54bed-5924-49f9-bb49-3d399770ccbe" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.598492] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9ec54bed-5924-49f9-bb49-3d399770ccbe" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.598492] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9ec54bed-5924-49f9-bb49-3d399770ccbe" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.598492] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9ec54bed-5924-49f9-bb49-3d399770ccbe',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.647369] env[65337]: INFO networking_nsxv3.common.synchronization [req-e94289eb-a447-42bf-a156-8fafd41e1381 req-4076cf49-cff0-470c-9234-a013e634902c tempest-ServerActionsTestOtherA-84911055 tempest-ServerActionsTestOtherA-84911055-project-member] Enqueued Resource ID: a4a9546d-8cbc-404d-acef-d7856f353fbe with Priority: HIGHEST for action security_group_members [ 1192.647932] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4a9546d-8cbc-404d-acef-d7856f353fbe with Priority: HIGHEST for action security_group_members [ 1192.648268] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4a9546d-8cbc-404d-acef-d7856f353fbe taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.648420] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4a9546d-8cbc-404d-acef-d7856f353fbe" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.648470] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4a9546d-8cbc-404d-acef-d7856f353fbe" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.648649] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4a9546d-8cbc-404d-acef-d7856f353fbe" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.648798] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.648894] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.648957] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.649115] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.649200] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.649295] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a4a9546d-8cbc-404d-acef-d7856f353fbe',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.096710] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fa9655b-7006-421a-adab-fda9e0c1520c taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.096862] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fa9655b-7006-421a-adab-fda9e0c1520c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.099464] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7fa9655b-7006-421a-adab-fda9e0c1520c',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.100332] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9ec54bed-5924-49f9-bb49-3d399770ccbe with status ACTIVE [ 1193.100576] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.100693] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.100764] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.100981] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.101090] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.101275] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.101382] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.101438] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.101588] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.101661] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.101858] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.101963] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.102042] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.102181] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.102280] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.102404] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9ec54bed-5924-49f9-bb49-3d399770ccbe is going to be updated. [ 1193.129031] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.129031] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.129031] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.129031] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.129031] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.129031] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9ec54bed-5924-49f9-bb49-3d399770ccbe" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.151398] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a4a9546d-8cbc-404d-acef-d7856f353fbe',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.586107] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01a2d749-abdf-41c6-bf7b-54833d1bf23e in Status: SUCCESS [ 1193.586352] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01a2d749-abdf-41c6-bf7b-54833d1bf23e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.586531] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01a2d749-abdf-41c6-bf7b-54833d1bf23e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.586750] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01a2d749-abdf-41c6-bf7b-54833d1bf23e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.586941] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.587072] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.587144] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.587288] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.587371] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.587445] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01a2d749-abdf-41c6-bf7b-54833d1bf23e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.587538] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('01a2d749-abdf-41c6-bf7b-54833d1bf23e',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.588399] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01a2d749-abdf-41c6-bf7b-54833d1bf23e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.588527] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01a2d749-abdf-41c6-bf7b-54833d1bf23e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.588680] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.588778] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.588839] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.588978] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.589066] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.589168] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('01a2d749-abdf-41c6-bf7b-54833d1bf23e',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.604959] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7fa9655b-7006-421a-adab-fda9e0c1520c',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.654053] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a4a9546d-8cbc-404d-acef-d7856f353fbe',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.682058] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a64509fd-193d-41f5-8257-21afcd1d96a2 in Status: SUCCESS [ 1193.682309] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a64509fd-193d-41f5-8257-21afcd1d96a2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.682616] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a64509fd-193d-41f5-8257-21afcd1d96a2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.682710] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a64509fd-193d-41f5-8257-21afcd1d96a2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.682866] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.683008] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.683084] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.683241] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.683335] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.683493] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a64509fd-193d-41f5-8257-21afcd1d96a2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.683493] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a64509fd-193d-41f5-8257-21afcd1d96a2',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.091642] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-01a2d749-abdf-41c6-bf7b-54833d1bf23e taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.091857] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01a2d749-abdf-41c6-bf7b-54833d1bf23e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.091948] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('01a2d749-abdf-41c6-bf7b-54833d1bf23e',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.107067] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.107328] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.107328] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.107526] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.107614] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.107727] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fa9655b-7006-421a-adab-fda9e0c1520c is going to be created. [ 1194.134104] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.134273] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.134342] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.134540] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.134758] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.145034] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fa9655b-7006-421a-adab-fda9e0c1520c in Status: UNINITIALIZED for 2s [ 1194.156647] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.156775] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.156851] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.157081] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.157621] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.157621] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4a9546d-8cbc-404d-acef-d7856f353fbe is going to be updated. [ 1194.186063] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a64509fd-193d-41f5-8257-21afcd1d96a2',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.207948] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.207948] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.207948] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.208263] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.208405] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.219598] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4a9546d-8cbc-404d-acef-d7856f353fbe in Status: IN_PROGRESS for 2s [ 1194.594903] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('01a2d749-abdf-41c6-bf7b-54833d1bf23e',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.688939] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a64509fd-193d-41f5-8257-21afcd1d96a2: rpc.has_security_group_logging(os_id): False [ 1194.709256] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.709465] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.709465] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.709683] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.709781] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.710059] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.710193] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.710269] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.710467] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.710582] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.710687] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a64509fd-193d-41f5-8257-21afcd1d96a2 is going to be created. [ 1194.777772] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.777931] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.778011] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.778243] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.778471] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.790744] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a64509fd-193d-41f5-8257-21afcd1d96a2 in Status: IN_PROGRESS for 2s [ 1195.097610] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.097832] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.097832] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.098092] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.098182] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.098278] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01a2d749-abdf-41c6-bf7b-54833d1bf23e is going to be updated. [ 1195.130179] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.130370] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.130370] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.130539] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.130687] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.144276] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01a2d749-abdf-41c6-bf7b-54833d1bf23e in Status: IN_PROGRESS for 2s [ 1196.155486] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fa9655b-7006-421a-adab-fda9e0c1520c in Status: SUCCESS [ 1196.155854] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fa9655b-7006-421a-adab-fda9e0c1520c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.155906] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fa9655b-7006-421a-adab-fda9e0c1520c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.156201] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fa9655b-7006-421a-adab-fda9e0c1520c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.156597] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.156739] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.156845] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.157099] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.157201] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.157328] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fa9655b-7006-421a-adab-fda9e0c1520c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.157423] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7fa9655b-7006-421a-adab-fda9e0c1520c',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.229254] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4a9546d-8cbc-404d-acef-d7856f353fbe in Status: IN_PROGRESS for 4s [ 1196.661700] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7fa9655b-7006-421a-adab-fda9e0c1520c',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.821083] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a64509fd-193d-41f5-8257-21afcd1d96a2 in Status: SUCCESS [ 1196.821535] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a64509fd-193d-41f5-8257-21afcd1d96a2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.156597] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01a2d749-abdf-41c6-bf7b-54833d1bf23e in Status: SUCCESS [ 1197.156981] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01a2d749-abdf-41c6-bf7b-54833d1bf23e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.156981] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01a2d749-abdf-41c6-bf7b-54833d1bf23e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.157363] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01a2d749-abdf-41c6-bf7b-54833d1bf23e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.157581] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.157698] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.157762] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.157920] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.158030] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.158098] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01a2d749-abdf-41c6-bf7b-54833d1bf23e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.158250] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-01a2d749-abdf-41c6-bf7b-54833d1bf23e taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.158353] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01a2d749-abdf-41c6-bf7b-54833d1bf23e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.158400] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01a2d749-abdf-41c6-bf7b-54833d1bf23e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.158539] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01a2d749-abdf-41c6-bf7b-54833d1bf23e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.158676] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.158763] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.158821] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.158956] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.159913] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.160477] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01a2d749-abdf-41c6-bf7b-54833d1bf23e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.160618] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('01a2d749-abdf-41c6-bf7b-54833d1bf23e',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.164679] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7fa9655b-7006-421a-adab-fda9e0c1520c: rpc.has_security_group_logging(os_id): False [ 1197.184972] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.184972] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.184972] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.184972] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.184972] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.185347] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.185347] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.185347] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.185464] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.185538] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.185650] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7fa9655b-7006-421a-adab-fda9e0c1520c is going to be created. [ 1197.257463] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.257648] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.257705] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.258009] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.258208] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.274782] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7fa9655b-7006-421a-adab-fda9e0c1520c in Status: IN_PROGRESS for 2s [ 1197.648869] env[65337]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1197.649094] env[65337]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=4 [ 1197.662756] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 01a2d749-abdf-41c6-bf7b-54833d1bf23e: rpc.has_security_group_logging(os_id): False [ 1197.685416] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.685633] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.685690] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.685980] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.686121] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.686426] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.686601] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.686698] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.686928] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.687070] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.687399] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.687577] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.687677] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.687897] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.687990] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.688285] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.688455] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.688552] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.688770] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.688863] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.688949] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 01a2d749-abdf-41c6-bf7b-54833d1bf23e is going to be updated. [ 1197.773984] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.774260] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.774326] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.774549] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.774876] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.801429] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 01a2d749-abdf-41c6-bf7b-54833d1bf23e in Status: IN_PROGRESS for 2s [ 1198.239865] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4a9546d-8cbc-404d-acef-d7856f353fbe in Status: SUCCESS [ 1198.240140] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4a9546d-8cbc-404d-acef-d7856f353fbe" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.268199] env[65337]: INFO networking_nsxv3.common.synchronization [req-8ccc8bfb-c21e-4ed6-8fe2-6f9844508d76 req-9f630c27-113b-45f4-9786-892bcaf1dd13 tempest-MultipleCreateTestJSON-392767123 tempest-MultipleCreateTestJSON-392767123-project-member] Enqueued Resource ID: 01a2d749-abdf-41c6-bf7b-54833d1bf23e with Priority: HIGHEST for action security_group_members [ 1199.268745] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01a2d749-abdf-41c6-bf7b-54833d1bf23e with Priority: HIGHEST for action security_group_members [ 1199.269686] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-01a2d749-abdf-41c6-bf7b-54833d1bf23e taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.269686] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01a2d749-abdf-41c6-bf7b-54833d1bf23e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.269686] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01a2d749-abdf-41c6-bf7b-54833d1bf23e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.269686] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01a2d749-abdf-41c6-bf7b-54833d1bf23e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.271357] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.272034] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.272216] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.272539] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.272767] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.272973] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('01a2d749-abdf-41c6-bf7b-54833d1bf23e',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.276067] env[65337]: INFO networking_nsxv3.common.synchronization [req-2aeaa34e-76c9-462f-b918-88f65fcfb0d5 req-10d79b8e-923e-4665-aae8-14142165a5a6 tempest-MultipleCreateTestJSON-392767123 tempest-MultipleCreateTestJSON-392767123-project-member] Enqueued Resource ID: 01a2d749-abdf-41c6-bf7b-54833d1bf23e with Priority: HIGHEST for action security_group_members [ 1199.279679] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01a2d749-abdf-41c6-bf7b-54833d1bf23e with Priority: HIGHEST for action security_group_members [ 1199.280252] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-01a2d749-abdf-41c6-bf7b-54833d1bf23e taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.280461] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01a2d749-abdf-41c6-bf7b-54833d1bf23e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.293104] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7fa9655b-7006-421a-adab-fda9e0c1520c in Status: SUCCESS [ 1199.293395] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7fa9655b-7006-421a-adab-fda9e0c1520c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.780987] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.780987] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.780987] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.780987] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.780987] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.780987] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.780987] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.780987] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.780987] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.780987] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.780987] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01a2d749-abdf-41c6-bf7b-54833d1bf23e is going to be updated. [ 1199.818029] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.818029] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.818029] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.818029] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.818029] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.818029] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 01a2d749-abdf-41c6-bf7b-54833d1bf23e in Status: SUCCESS [ 1199.818457] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-01a2d749-abdf-41c6-bf7b-54833d1bf23e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.818656] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-01a2d749-abdf-41c6-bf7b-54833d1bf23e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.818841] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-01a2d749-abdf-41c6-bf7b-54833d1bf23e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.818927] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('01a2d749-abdf-41c6-bf7b-54833d1bf23e',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.826371] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01a2d749-abdf-41c6-bf7b-54833d1bf23e in Status: IN_PROGRESS for 2s [ 1200.343390] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.343829] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.343829] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.343829] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.344044] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.344090] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 01a2d749-abdf-41c6-bf7b-54833d1bf23e is going to be deleted. [ 1200.401493] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.402049] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.402049] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.402049] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.402238] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.402285] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-01a2d749-abdf-41c6-bf7b-54833d1bf23e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.837469] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01a2d749-abdf-41c6-bf7b-54833d1bf23e in Status: SUCCESS [ 1201.837862] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01a2d749-abdf-41c6-bf7b-54833d1bf23e deletion is rescheduled due to dependency. [ 1201.837907] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01a2d749-abdf-41c6-bf7b-54833d1bf23e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.838149] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01a2d749-abdf-41c6-bf7b-54833d1bf23e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.838479] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01a2d749-abdf-41c6-bf7b-54833d1bf23e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.838754] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.838921] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.839036] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.839286] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.839504] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.839545] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('01a2d749-abdf-41c6-bf7b-54833d1bf23e',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.343536] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.343536] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.343536] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.343796] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.343796] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.343979] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.344093] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.344155] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.344308] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.344386] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.344473] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01a2d749-abdf-41c6-bf7b-54833d1bf23e is going to be deleted. [ 1202.378564] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.378710] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.378751] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.378952] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.379086] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.379206] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01a2d749-abdf-41c6-bf7b-54833d1bf23e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.280669] env[65337]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1204.280953] env[65337]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1208.746455] env[65337]: INFO networking_nsxv3.common.synchronization [req-fa83199f-cedd-4334-b17b-9c916a42a780 req-cea4283e-81a9-48b4-bd44-9bcf1669e4f6 tempest-ServerActionsTestOtherA-84911055 tempest-ServerActionsTestOtherA-84911055-project-member] Enqueued Resource ID: a4a9546d-8cbc-404d-acef-d7856f353fbe with Priority: HIGHEST for action security_group_members [ 1208.747018] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4a9546d-8cbc-404d-acef-d7856f353fbe with Priority: HIGHEST for action security_group_members [ 1208.747380] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4a9546d-8cbc-404d-acef-d7856f353fbe taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.747509] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4a9546d-8cbc-404d-acef-d7856f353fbe" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.747577] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4a9546d-8cbc-404d-acef-d7856f353fbe" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.747772] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4a9546d-8cbc-404d-acef-d7856f353fbe" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.747920] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.748025] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.748087] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.748228] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.748310] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.748402] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a4a9546d-8cbc-404d-acef-d7856f353fbe',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.250632] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.250854] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.250854] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.251019] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.251379] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.251379] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.251477] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.251569] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.251907] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.251991] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.252093] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4a9546d-8cbc-404d-acef-d7856f353fbe is going to be updated. [ 1209.284976] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.284976] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.284976] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.285270] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.285270] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.294270] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4a9546d-8cbc-404d-acef-d7856f353fbe in Status: IN_PROGRESS for 2s [ 1210.448177] env[65337]: INFO networking_nsxv3.common.synchronization [None req-edb15e05-1dc1-47ef-bc9f-2bb415cfd7aa None None] Enqueued Resource ID: 54d53fa8-173d-482b-8c43-9753302f993b with Priority: HIGHEST for action port [ 1210.448762] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54d53fa8-173d-482b-8c43-9753302f993b with Priority: HIGHEST for action port [ 1210.449072] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-54d53fa8-173d-482b-8c43-9753302f993b taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.449196] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-54d53fa8-173d-482b-8c43-9753302f993b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.449263] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-54d53fa8-173d-482b-8c43-9753302f993b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.449516] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-54d53fa8-173d-482b-8c43-9753302f993b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.449599] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('54d53fa8-173d-482b-8c43-9753302f993b',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.954206] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 54d53fa8-173d-482b-8c43-9753302f993b [ 1210.954206] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.954206] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.954206] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.954206] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.954206] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.954206] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:54d53fa8-173d-482b-8c43-9753302f993b already deleted. [ 1210.954206] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-54d53fa8-173d-482b-8c43-9753302f993b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.308042] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4a9546d-8cbc-404d-acef-d7856f353fbe in Status: SUCCESS [ 1211.308970] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4a9546d-8cbc-404d-acef-d7856f353fbe deletion is rescheduled due to dependency. [ 1211.308970] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4a9546d-8cbc-404d-acef-d7856f353fbe" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.760068] env[65337]: INFO networking_nsxv3.common.synchronization [None req-51795cee-51fe-4517-8c40-69c6e0d5f986 None None] Enqueued Resource ID: b8047bd1-0770-45c6-8e8e-c6dfc9ff9bdc with Priority: HIGHEST for action port [ 1212.760330] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8047bd1-0770-45c6-8e8e-c6dfc9ff9bdc with Priority: HIGHEST for action port [ 1212.760967] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-b8047bd1-0770-45c6-8e8e-c6dfc9ff9bdc taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.761465] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b8047bd1-0770-45c6-8e8e-c6dfc9ff9bdc" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.761465] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b8047bd1-0770-45c6-8e8e-c6dfc9ff9bdc" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.761465] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b8047bd1-0770-45c6-8e8e-c6dfc9ff9bdc" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.761465] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b8047bd1-0770-45c6-8e8e-c6dfc9ff9bdc',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1213.264149] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b8047bd1-0770-45c6-8e8e-c6dfc9ff9bdc [ 1213.264421] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.264535] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.264600] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.264823] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.264916] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.265023] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b8047bd1-0770-45c6-8e8e-c6dfc9ff9bdc already deleted. [ 1213.265100] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b8047bd1-0770-45c6-8e8e-c6dfc9ff9bdc" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.115942] env[65337]: INFO networking_nsxv3.common.synchronization [None req-f1ebff6f-dcc4-48f0-b230-3d628caae657 None None] Enqueued Resource ID: b937255e-9fa2-4c74-b5c0-1ff10e203449 with Priority: HIGHEST for action port [ 1217.116552] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b937255e-9fa2-4c74-b5c0-1ff10e203449 with Priority: HIGHEST for action port [ 1217.116871] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-b937255e-9fa2-4c74-b5c0-1ff10e203449 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.116997] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b937255e-9fa2-4c74-b5c0-1ff10e203449" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.117083] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b937255e-9fa2-4c74-b5c0-1ff10e203449" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.117340] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b937255e-9fa2-4c74-b5c0-1ff10e203449" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.117454] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b937255e-9fa2-4c74-b5c0-1ff10e203449',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.620077] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b937255e-9fa2-4c74-b5c0-1ff10e203449 [ 1217.620316] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.620445] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.620514] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.620736] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.622220] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.622348] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b937255e-9fa2-4c74-b5c0-1ff10e203449 already deleted. [ 1217.622437] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b937255e-9fa2-4c74-b5c0-1ff10e203449" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.385604] env[65337]: INFO networking_nsxv3.common.synchronization [req-80f9e70d-cc35-4656-a8c7-ee1069bf949c req-7a836ceb-5eff-44fb-aa11-64326ca3f8fa tempest-ServerRescueNegativeTestJSON-59296460 tempest-ServerRescueNegativeTestJSON-59296460-project-member] Enqueued Resource ID: 846d69e3-9f9f-414f-912e-5a866002c853 with Priority: HIGHEST for action security_group_members [ 1218.386471] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 846d69e3-9f9f-414f-912e-5a866002c853 with Priority: HIGHEST for action security_group_members [ 1218.386809] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-846d69e3-9f9f-414f-912e-5a866002c853 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.386952] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-846d69e3-9f9f-414f-912e-5a866002c853" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.387028] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-846d69e3-9f9f-414f-912e-5a866002c853" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.387705] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-846d69e3-9f9f-414f-912e-5a866002c853" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.387705] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.387705] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.387705] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.387705] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.387969] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.387969] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('846d69e3-9f9f-414f-912e-5a866002c853',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1218.738775] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock network-960 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.738963] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "network-960" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.739106] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "network-960" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.739464] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "network-960" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.739734] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.739900] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.740030] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.740255] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.740399] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.740605] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1218.740718] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1218.740828] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1218.740937] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1218.741067] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1218.741175] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1218.741305] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1218.763660] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1218.763788] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1218.763928] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1218.764165] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "network-960" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.764525] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock port-6fc32cca-cbe1-4c52-b02e-0e8233b2e861 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.764702] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "port-6fc32cca-cbe1-4c52-b02e-0e8233b2e861" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.764820] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "port-6fc32cca-cbe1-4c52-b02e-0e8233b2e861" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.765313] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "port-6fc32cca-cbe1-4c52-b02e-0e8233b2e861" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.765313] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6fc32cca-cbe1-4c52-b02e-0e8233b2e861',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1218.890270] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.890872] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.891012] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.891270] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.891362] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.891571] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.891674] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.891736] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.891890] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.891968] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.892068] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 846d69e3-9f9f-414f-912e-5a866002c853 already deleted. [ 1218.892148] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-846d69e3-9f9f-414f-912e-5a866002c853" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.134567] env[65337]: INFO networking_nsxv3.common.synchronization [None req-cadb3abd-ccb3-4b90-8d48-e6664cce47ac None None] Enqueued Resource ID: 20a9b883-21db-435a-961a-faa25b61c602 with Priority: HIGHEST for action port [ 1219.135139] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20a9b883-21db-435a-961a-faa25b61c602 with Priority: HIGHEST for action port [ 1219.135451] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-20a9b883-21db-435a-961a-faa25b61c602 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.135603] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-20a9b883-21db-435a-961a-faa25b61c602" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.135676] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-20a9b883-21db-435a-961a-faa25b61c602" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.135961] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-20a9b883-21db-435a-961a-faa25b61c602" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.136009] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('20a9b883-21db-435a-961a-faa25b61c602',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.270018] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.270018] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.270018] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.270018] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.270018] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.270018] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Segment Port 6fc32cca-cbe1-4c52-b02e-0e8233b2e861 not found, creating... [ 1219.270018] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.270018] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.270018] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.270018] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.270018] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.270514] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.270514] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.270514] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.270826] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.271087] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.271330] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Resource: SegmentPort with ID: 6fc32cca-cbe1-4c52-b02e-0e8233b2e861 is going to be created. [ 1219.295242] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.295242] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.295242] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.295242] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.295601] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.295950] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "port-6fc32cca-cbe1-4c52-b02e-0e8233b2e861" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.638495] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 20a9b883-21db-435a-961a-faa25b61c602 [ 1219.638869] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.639085] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.639208] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.639496] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.639641] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.640357] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:20a9b883-21db-435a-961a-faa25b61c602 already deleted. [ 1219.640357] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-20a9b883-21db-435a-961a-faa25b61c602" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.987689] env[65337]: INFO networking_nsxv3.common.synchronization [req-80f9e70d-cc35-4656-a8c7-ee1069bf949c req-f2b423b2-91c9-41c6-937e-f2121933a476 service nova] Enqueued Resource ID: 846d69e3-9f9f-414f-912e-5a866002c853 with Priority: HIGHEST for action security_group_rules [ 1219.987930] env[65337]: INFO networking_nsxv3.common.synchronization [req-80f9e70d-cc35-4656-a8c7-ee1069bf949c req-f2b423b2-91c9-41c6-937e-f2121933a476 service nova] Enqueued Resource ID: 846d69e3-9f9f-414f-912e-5a866002c853 with Priority: HIGHEST for action security_group_members [ 1219.988152] env[65337]: INFO networking_nsxv3.common.synchronization [req-80f9e70d-cc35-4656-a8c7-ee1069bf949c req-f2b423b2-91c9-41c6-937e-f2121933a476 service nova] Enqueued Resource ID: 6fc32cca-cbe1-4c52-b02e-0e8233b2e861 with Priority: HIGHEST for action port [ 1219.988689] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 846d69e3-9f9f-414f-912e-5a866002c853 with Priority: HIGHEST for action security_group_rules [ 1219.988925] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 846d69e3-9f9f-414f-912e-5a866002c853 with Priority: HIGHEST for action security_group_members [ 1219.989093] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fc32cca-cbe1-4c52-b02e-0e8233b2e861 with Priority: HIGHEST for action port [ 1219.989393] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-846d69e3-9f9f-414f-912e-5a866002c853 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.989683] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-846d69e3-9f9f-414f-912e-5a866002c853" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.989683] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-846d69e3-9f9f-414f-912e-5a866002c853" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.989888] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-846d69e3-9f9f-414f-912e-5a866002c853" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.989989] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('846d69e3-9f9f-414f-912e-5a866002c853',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.990843] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-846d69e3-9f9f-414f-912e-5a866002c853 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.991012] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-846d69e3-9f9f-414f-912e-5a866002c853" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.991117] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-846d69e3-9f9f-414f-912e-5a866002c853" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.991311] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-846d69e3-9f9f-414f-912e-5a866002c853" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.991483] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.991603] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.991684] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.991844] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.991952] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.992109] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('846d69e3-9f9f-414f-912e-5a866002c853',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.993019] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-6fc32cca-cbe1-4c52-b02e-0e8233b2e861 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.994239] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6fc32cca-cbe1-4c52-b02e-0e8233b2e861" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.994239] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6fc32cca-cbe1-4c52-b02e-0e8233b2e861" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.994239] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6fc32cca-cbe1-4c52-b02e-0e8233b2e861" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.994239] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6fc32cca-cbe1-4c52-b02e-0e8233b2e861',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.495939] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-846d69e3-9f9f-414f-912e-5a866002c853 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.495939] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-846d69e3-9f9f-414f-912e-5a866002c853" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.495939] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('846d69e3-9f9f-414f-912e-5a866002c853',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.496889] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6fc32cca-cbe1-4c52-b02e-0e8233b2e861 with status ACTIVE [ 1220.497138] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.497258] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.497320] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.497551] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.497673] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.497789] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.497914] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.498200] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.498200] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.498200] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.498471] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.498471] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.498471] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.498714] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.498714] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.498812] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6fc32cca-cbe1-4c52-b02e-0e8233b2e861 is going to be updated. [ 1220.521155] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.521345] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.521345] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.521553] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.521682] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.521840] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6fc32cca-cbe1-4c52-b02e-0e8233b2e861" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.638623] env[65337]: INFO networking_nsxv3.common.synchronization [req-86e16ffc-4e49-4a89-ab61-5d855a04fd10 req-087bf9b9-cebe-47b6-84ce-882ded41e152 tempest-ServerRescueNegativeTestJSON-59296460 tempest-ServerRescueNegativeTestJSON-59296460-project-member] Enqueued Resource ID: 846d69e3-9f9f-414f-912e-5a866002c853 with Priority: HIGHEST for action security_group_members [ 1220.639370] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 846d69e3-9f9f-414f-912e-5a866002c853 with Priority: HIGHEST for action security_group_members [ 1220.639894] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-846d69e3-9f9f-414f-912e-5a866002c853 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.639894] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-846d69e3-9f9f-414f-912e-5a866002c853" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.921957] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock network-960 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.922241] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "network-960" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.923030] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "network-960" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.923030] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "network-960" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.923030] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.923250] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.923250] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.923630] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.923702] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.923887] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1220.924029] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1220.924150] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1220.925110] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1220.925110] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1220.925110] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1220.925110] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1220.945910] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1220.946128] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1220.946230] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1220.946466] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "network-960" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.946783] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock port-8705c74e-4f01-4718-83e9-c50565558c84 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.946958] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "port-8705c74e-4f01-4718-83e9-c50565558c84" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.947088] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "port-8705c74e-4f01-4718-83e9-c50565558c84" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.947421] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "port-8705c74e-4f01-4718-83e9-c50565558c84" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.947585] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8705c74e-4f01-4718-83e9-c50565558c84',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.000942] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('846d69e3-9f9f-414f-912e-5a866002c853',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.450022] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.450330] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.450462] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.450746] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.450894] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.451073] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Segment Port 8705c74e-4f01-4718-83e9-c50565558c84 not found, creating... [ 1221.451350] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.451514] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.451659] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.451883] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.452026] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.452311] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.452460] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.452575] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.452776] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.452907] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.453063] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Resource: SegmentPort with ID: 8705c74e-4f01-4718-83e9-c50565558c84 is going to be created. [ 1221.476348] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.476691] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.476741] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.477025] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.477260] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.477504] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "port-8705c74e-4f01-4718-83e9-c50565558c84" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.503261] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.503487] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.503487] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.503798] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.503798] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.503904] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 846d69e3-9f9f-414f-912e-5a866002c853 is going to be created. [ 1221.531727] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.531897] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.531935] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.532167] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.532321] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.543196] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 846d69e3-9f9f-414f-912e-5a866002c853 in Status: UNINITIALIZED for 2s [ 1222.193535] env[65337]: INFO networking_nsxv3.common.synchronization [req-6fc0e515-b504-4de5-a64a-44e9678aab7c req-01b1a049-7dcc-40a3-a6d7-2b7095503eae tempest-ServersV294TestFqdnHostnames-583565518 tempest-ServersV294TestFqdnHostnames-583565518-project-member] Enqueued Resource ID: a5a16fe4-8172-4f86-bfcd-dba6afcdd876 with Priority: HIGHEST for action security_group_members [ 1222.194169] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5a16fe4-8172-4f86-bfcd-dba6afcdd876 with Priority: HIGHEST for action security_group_members [ 1222.194523] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5a16fe4-8172-4f86-bfcd-dba6afcdd876 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.194674] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5a16fe4-8172-4f86-bfcd-dba6afcdd876" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.194762] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5a16fe4-8172-4f86-bfcd-dba6afcdd876" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.194988] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5a16fe4-8172-4f86-bfcd-dba6afcdd876" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.195264] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.195361] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.195361] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.195626] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.195626] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.195717] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a5a16fe4-8172-4f86-bfcd-dba6afcdd876',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1222.210447] env[65337]: INFO networking_nsxv3.common.synchronization [req-86e16ffc-4e49-4a89-ab61-5d855a04fd10 req-f276adbd-bc32-4227-be50-9bd85c816600 service nova] Enqueued Resource ID: 846d69e3-9f9f-414f-912e-5a866002c853 with Priority: HIGHEST for action security_group_rules [ 1222.210556] env[65337]: INFO networking_nsxv3.common.synchronization [req-86e16ffc-4e49-4a89-ab61-5d855a04fd10 req-f276adbd-bc32-4227-be50-9bd85c816600 service nova] Enqueued Resource ID: 846d69e3-9f9f-414f-912e-5a866002c853 with Priority: HIGHEST for action security_group_members [ 1222.210646] env[65337]: INFO networking_nsxv3.common.synchronization [req-86e16ffc-4e49-4a89-ab61-5d855a04fd10 req-f276adbd-bc32-4227-be50-9bd85c816600 service nova] Enqueued Resource ID: 8705c74e-4f01-4718-83e9-c50565558c84 with Priority: HIGHEST for action port [ 1222.211147] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 846d69e3-9f9f-414f-912e-5a866002c853 with Priority: HIGHEST for action security_group_rules [ 1222.211314] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 846d69e3-9f9f-414f-912e-5a866002c853 with Priority: HIGHEST for action security_group_members [ 1222.211416] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8705c74e-4f01-4718-83e9-c50565558c84 with Priority: HIGHEST for action port [ 1222.211942] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-846d69e3-9f9f-414f-912e-5a866002c853 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.212121] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-846d69e3-9f9f-414f-912e-5a866002c853" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.212503] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-846d69e3-9f9f-414f-912e-5a866002c853 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.212503] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-846d69e3-9f9f-414f-912e-5a866002c853" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.212671] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-8705c74e-4f01-4718-83e9-c50565558c84 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.212832] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8705c74e-4f01-4718-83e9-c50565558c84" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.212917] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8705c74e-4f01-4718-83e9-c50565558c84" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.213182] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8705c74e-4f01-4718-83e9-c50565558c84" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.213255] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8705c74e-4f01-4718-83e9-c50565558c84',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1222.698035] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.698035] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.698265] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.698299] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.715310] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8705c74e-4f01-4718-83e9-c50565558c84 with status ACTIVE [ 1222.715524] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.715674] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.715784] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.716016] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.716172] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.716402] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.716560] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.716624] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.716787] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.716868] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.717124] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.717280] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.717389] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.717604] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.717729] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.717835] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8705c74e-4f01-4718-83e9-c50565558c84 is going to be updated. [ 1222.726740] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.726988] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.727120] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.727214] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.727402] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.727511] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.727588] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a5a16fe4-8172-4f86-bfcd-dba6afcdd876 is going to be updated. [ 1222.740354] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.740533] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.740533] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.740743] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.740882] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.741055] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8705c74e-4f01-4718-83e9-c50565558c84" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.755590] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.755837] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.755837] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.755968] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.756097] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.765016] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5a16fe4-8172-4f86-bfcd-dba6afcdd876 in Status: IN_PROGRESS for 2s [ 1223.553636] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 846d69e3-9f9f-414f-912e-5a866002c853 in Status: SUCCESS [ 1223.553939] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-846d69e3-9f9f-414f-912e-5a866002c853" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.553999] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-846d69e3-9f9f-414f-912e-5a866002c853" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.554315] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-846d69e3-9f9f-414f-912e-5a866002c853" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.554592] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.554711] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.554775] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.554937] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.555045] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.555113] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-846d69e3-9f9f-414f-912e-5a866002c853" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.555210] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('846d69e3-9f9f-414f-912e-5a866002c853',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.556092] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-846d69e3-9f9f-414f-912e-5a866002c853" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.556257] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-846d69e3-9f9f-414f-912e-5a866002c853" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.556491] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.556703] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.556786] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.556968] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.557069] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.557161] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('846d69e3-9f9f-414f-912e-5a866002c853',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.059283] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-846d69e3-9f9f-414f-912e-5a866002c853 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.059524] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-846d69e3-9f9f-414f-912e-5a866002c853" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.061828] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('846d69e3-9f9f-414f-912e-5a866002c853',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.564810] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('846d69e3-9f9f-414f-912e-5a866002c853',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.775748] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5a16fe4-8172-4f86-bfcd-dba6afcdd876 in Status: SUCCESS [ 1224.775932] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a5a16fe4-8172-4f86-bfcd-dba6afcdd876 deletion is rescheduled due to dependency. [ 1224.776055] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5a16fe4-8172-4f86-bfcd-dba6afcdd876" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.067411] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.067619] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.067619] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.068021] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.068189] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.068438] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 846d69e3-9f9f-414f-912e-5a866002c853 is going to be updated. [ 1225.104177] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.104402] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.104480] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.104652] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.104842] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.116616] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 846d69e3-9f9f-414f-912e-5a866002c853 in Status: IN_PROGRESS for 2s [ 1225.893872] env[65337]: INFO networking_nsxv3.common.synchronization [req-b6485ac3-94d0-4702-a457-90187a7272bb req-80e00f5b-2cc2-41bc-b5dc-05d6c1aaf8a2 tempest-ServerPasswordTestJSON-927370012 tempest-ServerPasswordTestJSON-927370012-project-member] Enqueued Resource ID: 9c4e6dd2-ce42-4c12-a876-a0055bfa44f3 with Priority: HIGHEST for action security_group_members [ 1225.895073] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c4e6dd2-ce42-4c12-a876-a0055bfa44f3 with Priority: HIGHEST for action security_group_members [ 1225.895073] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c4e6dd2-ce42-4c12-a876-a0055bfa44f3 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.895073] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c4e6dd2-ce42-4c12-a876-a0055bfa44f3" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.895495] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c4e6dd2-ce42-4c12-a876-a0055bfa44f3" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.895495] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c4e6dd2-ce42-4c12-a876-a0055bfa44f3" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.895598] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.895684] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.895684] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.895872] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.895954] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.896022] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9c4e6dd2-ce42-4c12-a876-a0055bfa44f3',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.272464] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock network-497 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.272688] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "network-497" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.272782] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "network-497" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.273188] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "network-497" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.273453] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.273621] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.273719] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.274148] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.274148] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.274267] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1226.274455] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1226.274615] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1226.274730] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1226.274842] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1226.274945] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1226.275106] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1226.299370] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1226.299370] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1226.299370] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1226.299370] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "network-497" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.299370] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock port-9b6fc7bf-ce1c-4a9d-8766-fd07e990bb23 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.299370] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "port-9b6fc7bf-ce1c-4a9d-8766-fd07e990bb23" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.299370] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "port-9b6fc7bf-ce1c-4a9d-8766-fd07e990bb23" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.299370] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "port-9b6fc7bf-ce1c-4a9d-8766-fd07e990bb23" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.299370] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9b6fc7bf-ce1c-4a9d-8766-fd07e990bb23',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.359700] env[65337]: INFO networking_nsxv3.common.synchronization [req-416aaaea-912d-48c0-8976-de2f00e89a23 req-d9ba6b6d-295b-408e-9cc3-328581fc496b tempest-ServerActionsTestJSON-704073373 tempest-ServerActionsTestJSON-704073373-project-member] Enqueued Resource ID: 5f51b41c-ca91-45cf-92a6-17398a529bbb with Priority: HIGHEST for action security_group_members [ 1226.360285] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f51b41c-ca91-45cf-92a6-17398a529bbb with Priority: HIGHEST for action security_group_members [ 1226.360586] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f51b41c-ca91-45cf-92a6-17398a529bbb taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.360704] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f51b41c-ca91-45cf-92a6-17398a529bbb" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.360779] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f51b41c-ca91-45cf-92a6-17398a529bbb" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.360974] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f51b41c-ca91-45cf-92a6-17398a529bbb" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.361858] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.361987] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.362064] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.362218] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.362299] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.362398] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5f51b41c-ca91-45cf-92a6-17398a529bbb',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.398704] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.399051] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.399051] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.399290] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.399402] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.399539] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.399667] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.399749] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.399877] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.399970] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.400080] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9c4e6dd2-ce42-4c12-a876-a0055bfa44f3 already deleted. [ 1226.400166] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c4e6dd2-ce42-4c12-a876-a0055bfa44f3" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.802577] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.802918] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.803039] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.803384] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.803551] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.803714] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Segment Port 9b6fc7bf-ce1c-4a9d-8766-fd07e990bb23 not found, creating... [ 1226.804013] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.804248] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.804409] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.804703] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.804905] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.805373] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.805549] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.805628] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.805870] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.806043] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.806174] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Resource: SegmentPort with ID: 9b6fc7bf-ce1c-4a9d-8766-fd07e990bb23 is going to be created. [ 1226.829735] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.829985] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.830168] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.830586] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.830772] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.831065] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "port-9b6fc7bf-ce1c-4a9d-8766-fd07e990bb23" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.864158] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.864374] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.864374] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.864648] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.898697] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.899122] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.899336] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.899454] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.899700] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.899794] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.899900] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5f51b41c-ca91-45cf-92a6-17398a529bbb is going to be updated. [ 1226.959548] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.959845] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.959984] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.960315] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.960494] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.972419] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f51b41c-ca91-45cf-92a6-17398a529bbb in Status: IN_PROGRESS for 2s [ 1227.125901] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 846d69e3-9f9f-414f-912e-5a866002c853 in Status: SUCCESS [ 1227.126151] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-846d69e3-9f9f-414f-912e-5a866002c853" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.126327] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-846d69e3-9f9f-414f-912e-5a866002c853" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.126589] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-846d69e3-9f9f-414f-912e-5a866002c853" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.126804] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.126893] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.126938] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.127424] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.127424] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.127424] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('846d69e3-9f9f-414f-912e-5a866002c853',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.629774] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('846d69e3-9f9f-414f-912e-5a866002c853',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.947091] env[65337]: INFO networking_nsxv3.common.synchronization [req-b6485ac3-94d0-4702-a457-90187a7272bb req-7d78d3af-d888-4733-82fe-cbf6737f95d8 service nova] Enqueued Resource ID: 9c4e6dd2-ce42-4c12-a876-a0055bfa44f3 with Priority: HIGHEST for action security_group_rules [ 1227.947341] env[65337]: INFO networking_nsxv3.common.synchronization [req-b6485ac3-94d0-4702-a457-90187a7272bb req-7d78d3af-d888-4733-82fe-cbf6737f95d8 service nova] Enqueued Resource ID: 9c4e6dd2-ce42-4c12-a876-a0055bfa44f3 with Priority: HIGHEST for action security_group_members [ 1227.947545] env[65337]: INFO networking_nsxv3.common.synchronization [req-b6485ac3-94d0-4702-a457-90187a7272bb req-7d78d3af-d888-4733-82fe-cbf6737f95d8 service nova] Enqueued Resource ID: 9b6fc7bf-ce1c-4a9d-8766-fd07e990bb23 with Priority: HIGHEST for action port [ 1227.948016] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c4e6dd2-ce42-4c12-a876-a0055bfa44f3 with Priority: HIGHEST for action security_group_rules [ 1227.948176] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c4e6dd2-ce42-4c12-a876-a0055bfa44f3 with Priority: HIGHEST for action security_group_members [ 1227.948275] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b6fc7bf-ce1c-4a9d-8766-fd07e990bb23 with Priority: HIGHEST for action port [ 1227.948556] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9c4e6dd2-ce42-4c12-a876-a0055bfa44f3 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.948692] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9c4e6dd2-ce42-4c12-a876-a0055bfa44f3" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.948728] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9c4e6dd2-ce42-4c12-a876-a0055bfa44f3" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.948995] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9c4e6dd2-ce42-4c12-a876-a0055bfa44f3" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.949305] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9c4e6dd2-ce42-4c12-a876-a0055bfa44f3',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.949883] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c4e6dd2-ce42-4c12-a876-a0055bfa44f3 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.949994] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c4e6dd2-ce42-4c12-a876-a0055bfa44f3" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.950071] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c4e6dd2-ce42-4c12-a876-a0055bfa44f3" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.950236] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c4e6dd2-ce42-4c12-a876-a0055bfa44f3" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.950373] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.950468] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.950530] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.950663] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.950742] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.950822] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9c4e6dd2-ce42-4c12-a876-a0055bfa44f3',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.951524] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-9b6fc7bf-ce1c-4a9d-8766-fd07e990bb23 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.951639] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9b6fc7bf-ce1c-4a9d-8766-fd07e990bb23" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.951685] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9b6fc7bf-ce1c-4a9d-8766-fd07e990bb23" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.951827] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9b6fc7bf-ce1c-4a9d-8766-fd07e990bb23" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.951897] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9b6fc7bf-ce1c-4a9d-8766-fd07e990bb23',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.131791] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('846d69e3-9f9f-414f-912e-5a866002c853',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.454212] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c4e6dd2-ce42-4c12-a876-a0055bfa44f3 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.455025] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c4e6dd2-ce42-4c12-a876-a0055bfa44f3" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.455025] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9c4e6dd2-ce42-4c12-a876-a0055bfa44f3',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.456096] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9b6fc7bf-ce1c-4a9d-8766-fd07e990bb23 with status ACTIVE [ 1228.456096] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.456096] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.456096] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.456297] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.456345] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.456758] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.456758] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.456758] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.456907] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.456939] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.457468] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.457582] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.457649] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.457795] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.457873] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.457959] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9b6fc7bf-ce1c-4a9d-8766-fd07e990bb23 is going to be updated. [ 1228.480537] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.480537] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.480657] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.481673] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.481673] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.481673] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9b6fc7bf-ce1c-4a9d-8766-fd07e990bb23" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.636744] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.636744] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.636744] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.636744] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.636744] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.636744] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 846d69e3-9f9f-414f-912e-5a866002c853 is going to be updated. [ 1228.665992] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.665992] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.665992] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.665992] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.665992] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.698272] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 846d69e3-9f9f-414f-912e-5a866002c853 in Status: IN_PROGRESS for 2s [ 1228.960335] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9c4e6dd2-ce42-4c12-a876-a0055bfa44f3',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.982826] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f51b41c-ca91-45cf-92a6-17398a529bbb in Status: SUCCESS [ 1228.983035] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5f51b41c-ca91-45cf-92a6-17398a529bbb deletion is rescheduled due to dependency. [ 1228.983083] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f51b41c-ca91-45cf-92a6-17398a529bbb" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.465606] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.466505] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.466505] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.466505] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.466505] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.466638] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9c4e6dd2-ce42-4c12-a876-a0055bfa44f3 is going to be created. [ 1229.489949] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.490118] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.490180] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.490399] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.490554] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.501116] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9c4e6dd2-ce42-4c12-a876-a0055bfa44f3 in Status: UNINITIALIZED for 2s [ 1230.709178] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 846d69e3-9f9f-414f-912e-5a866002c853 in Status: SUCCESS [ 1230.709564] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-846d69e3-9f9f-414f-912e-5a866002c853" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.709564] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-846d69e3-9f9f-414f-912e-5a866002c853" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.709777] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-846d69e3-9f9f-414f-912e-5a866002c853" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.709968] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.710098] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.710159] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.710311] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.710389] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.710471] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-846d69e3-9f9f-414f-912e-5a866002c853" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.710652] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-846d69e3-9f9f-414f-912e-5a866002c853 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.710752] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-846d69e3-9f9f-414f-912e-5a866002c853" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.710810] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-846d69e3-9f9f-414f-912e-5a866002c853" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.710953] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-846d69e3-9f9f-414f-912e-5a866002c853" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.711102] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.711192] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.711251] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.711387] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.711462] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.711542] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-846d69e3-9f9f-414f-912e-5a866002c853" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.711656] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('846d69e3-9f9f-414f-912e-5a866002c853',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.214336] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 846d69e3-9f9f-414f-912e-5a866002c853: rpc.has_security_group_logging(os_id): False [ 1231.235258] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.235498] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.235498] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.235788] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.235829] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.236061] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.236164] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.236208] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.236381] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.236491] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.236704] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.236827] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.236896] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.237052] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.237128] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.237321] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.237410] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.237469] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.237609] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.237685] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.237771] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 846d69e3-9f9f-414f-912e-5a866002c853 is going to be created. [ 1231.301868] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.302117] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.302117] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.302308] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.302489] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.314733] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 846d69e3-9f9f-414f-912e-5a866002c853 in Status: IN_PROGRESS for 2s [ 1231.510306] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9c4e6dd2-ce42-4c12-a876-a0055bfa44f3 in Status: SUCCESS [ 1231.510571] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c4e6dd2-ce42-4c12-a876-a0055bfa44f3" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.510808] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c4e6dd2-ce42-4c12-a876-a0055bfa44f3" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.511029] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c4e6dd2-ce42-4c12-a876-a0055bfa44f3" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.511247] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.511381] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.511449] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.511625] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.511707] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.511828] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c4e6dd2-ce42-4c12-a876-a0055bfa44f3" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.511969] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9c4e6dd2-ce42-4c12-a876-a0055bfa44f3',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.858647] env[65337]: INFO networking_nsxv3.common.synchronization [None req-b6f1f047-664b-4d6e-b784-7488bbf7d77a None None] Enqueued Resource ID: b0085ec1-fc56-491b-adbd-95bf179fe354 with Priority: HIGHEST for action port [ 1231.859247] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0085ec1-fc56-491b-adbd-95bf179fe354 with Priority: HIGHEST for action port [ 1231.859565] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-b0085ec1-fc56-491b-adbd-95bf179fe354 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.859686] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b0085ec1-fc56-491b-adbd-95bf179fe354" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.859751] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b0085ec1-fc56-491b-adbd-95bf179fe354" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.860013] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b0085ec1-fc56-491b-adbd-95bf179fe354" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.861448] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b0085ec1-fc56-491b-adbd-95bf179fe354',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1232.016420] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c4e6dd2-ce42-4c12-a876-a0055bfa44f3 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.016420] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c4e6dd2-ce42-4c12-a876-a0055bfa44f3" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.016420] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c4e6dd2-ce42-4c12-a876-a0055bfa44f3" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.016420] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c4e6dd2-ce42-4c12-a876-a0055bfa44f3" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.016420] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.016420] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.018306] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.019806] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.019927] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.020874] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c4e6dd2-ce42-4c12-a876-a0055bfa44f3" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.020874] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c4e6dd2-ce42-4c12-a876-a0055bfa44f3 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.020874] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c4e6dd2-ce42-4c12-a876-a0055bfa44f3" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.021780] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c4e6dd2-ce42-4c12-a876-a0055bfa44f3" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.021780] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c4e6dd2-ce42-4c12-a876-a0055bfa44f3" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.021780] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.021935] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.021935] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.022746] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.022746] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.022746] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c4e6dd2-ce42-4c12-a876-a0055bfa44f3" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.022746] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9c4e6dd2-ce42-4c12-a876-a0055bfa44f3',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1232.364301] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b0085ec1-fc56-491b-adbd-95bf179fe354 [ 1232.364620] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.364754] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.364834] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.365083] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.365176] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.365271] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b0085ec1-fc56-491b-adbd-95bf179fe354 already deleted. [ 1232.365355] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b0085ec1-fc56-491b-adbd-95bf179fe354" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.526744] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9c4e6dd2-ce42-4c12-a876-a0055bfa44f3: rpc.has_security_group_logging(os_id): False [ 1232.556058] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.556058] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.556058] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.556391] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.556391] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.556664] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.556783] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.556847] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.557016] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.557099] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.557305] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.557469] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.557469] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.557625] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.557699] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.557912] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.558000] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.558083] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.558241] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.558315] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.558400] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9c4e6dd2-ce42-4c12-a876-a0055bfa44f3 is going to be created. [ 1232.630068] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.630068] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.630068] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.630423] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.631037] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.655790] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9c4e6dd2-ce42-4c12-a876-a0055bfa44f3 in Status: IN_PROGRESS for 2s [ 1233.328582] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 846d69e3-9f9f-414f-912e-5a866002c853 in Status: SUCCESS [ 1233.328848] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-846d69e3-9f9f-414f-912e-5a866002c853" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.328970] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-846d69e3-9f9f-414f-912e-5a866002c853" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.329200] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-846d69e3-9f9f-414f-912e-5a866002c853" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.329287] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('846d69e3-9f9f-414f-912e-5a866002c853',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1233.831816] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-846d69e3-9f9f-414f-912e-5a866002c853 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.832052] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-846d69e3-9f9f-414f-912e-5a866002c853" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.832052] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-846d69e3-9f9f-414f-912e-5a866002c853" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.832341] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-846d69e3-9f9f-414f-912e-5a866002c853" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.832462] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.832586] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.832634] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.832775] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.834051] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.834051] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-846d69e3-9f9f-414f-912e-5a866002c853" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.834051] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('846d69e3-9f9f-414f-912e-5a866002c853',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1234.028785] env[65337]: INFO networking_nsxv3.common.synchronization [req-7327a91a-ef47-4b20-9f7f-ee72053fbf39 req-68d17799-81ad-46c5-b1b0-eaa2c1c9383d tempest-ServerActionsTestJSON-704073373 tempest-ServerActionsTestJSON-704073373-project-member] Enqueued Resource ID: 5f51b41c-ca91-45cf-92a6-17398a529bbb with Priority: HIGHEST for action security_group_members [ 1234.029474] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f51b41c-ca91-45cf-92a6-17398a529bbb with Priority: HIGHEST for action security_group_members [ 1234.029850] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f51b41c-ca91-45cf-92a6-17398a529bbb taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.030000] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f51b41c-ca91-45cf-92a6-17398a529bbb" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.030074] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f51b41c-ca91-45cf-92a6-17398a529bbb" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.030313] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f51b41c-ca91-45cf-92a6-17398a529bbb" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.030500] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.030584] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.030640] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.030821] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.030906] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.031017] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5f51b41c-ca91-45cf-92a6-17398a529bbb',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1234.338037] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-846d69e3-9f9f-414f-912e-5a866002c853 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.338037] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-846d69e3-9f9f-414f-912e-5a866002c853" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.338037] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-846d69e3-9f9f-414f-912e-5a866002c853" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.338037] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-846d69e3-9f9f-414f-912e-5a866002c853" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.338037] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.338037] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.338037] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.338037] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.338037] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.338037] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-846d69e3-9f9f-414f-912e-5a866002c853" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.338037] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-846d69e3-9f9f-414f-912e-5a866002c853 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.338037] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-846d69e3-9f9f-414f-912e-5a866002c853" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.338037] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-846d69e3-9f9f-414f-912e-5a866002c853" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.338037] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-846d69e3-9f9f-414f-912e-5a866002c853" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.338037] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.338037] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.339094] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.339094] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.339094] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.339094] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-846d69e3-9f9f-414f-912e-5a866002c853" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.339094] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('846d69e3-9f9f-414f-912e-5a866002c853',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1234.378085] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock network-433 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.378293] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "network-433" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.378416] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "network-433" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.378680] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "network-433" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.378951] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.379456] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.379650] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.379918] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.380130] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.380506] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1234.380700] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1234.380861] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1234.381038] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1234.381208] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1234.381360] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1234.381537] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1234.401888] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1234.402201] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1234.402530] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1234.402810] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "network-433" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.403372] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock port-0d74fda8-806f-4134-854d-9f7197ea9c5b taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.403664] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "port-0d74fda8-806f-4134-854d-9f7197ea9c5b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.403863] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "port-0d74fda8-806f-4134-854d-9f7197ea9c5b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.404331] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "port-0d74fda8-806f-4134-854d-9f7197ea9c5b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.404589] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0d74fda8-806f-4134-854d-9f7197ea9c5b',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1234.424540] env[65337]: INFO networking_nsxv3.common.synchronization [None req-df95fa5e-5efe-4c51-a6e1-0f830f714ca4 None None] Enqueued Resource ID: 5149b744-44c8-4c79-817b-8ab2c5f59613 with Priority: HIGHEST for action port [ 1234.425103] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5149b744-44c8-4c79-817b-8ab2c5f59613 with Priority: HIGHEST for action port [ 1234.425402] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-5149b744-44c8-4c79-817b-8ab2c5f59613 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.425559] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5149b744-44c8-4c79-817b-8ab2c5f59613" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.425653] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5149b744-44c8-4c79-817b-8ab2c5f59613" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.425837] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5149b744-44c8-4c79-817b-8ab2c5f59613" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.425951] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5149b744-44c8-4c79-817b-8ab2c5f59613',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1234.533762] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.533762] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.533762] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.533762] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.533762] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.534281] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.534281] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.534281] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.534281] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.535316] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.535316] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5f51b41c-ca91-45cf-92a6-17398a529bbb is going to be updated. [ 1234.570833] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.571177] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.571177] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.572089] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.572089] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.586521] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f51b41c-ca91-45cf-92a6-17398a529bbb in Status: IN_PROGRESS for 2s [ 1234.671099] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9c4e6dd2-ce42-4c12-a876-a0055bfa44f3 in Status: SUCCESS [ 1234.671099] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9c4e6dd2-ce42-4c12-a876-a0055bfa44f3" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.842411] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 846d69e3-9f9f-414f-912e-5a866002c853: rpc.has_security_group_logging(os_id): False [ 1234.863142] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.863310] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.863405] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.863614] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.863715] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.863912] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.864054] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.864121] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.864270] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.864387] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.864594] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.864687] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.864747] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.864908] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.864978] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.865178] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.865289] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.865350] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.865501] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.865576] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.865661] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 846d69e3-9f9f-414f-912e-5a866002c853 is going to be updated. [ 1234.908549] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.908775] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.909567] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.909567] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.909567] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.909669] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Segment Port 0d74fda8-806f-4134-854d-9f7197ea9c5b not found, creating... [ 1234.909941] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.910250] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.910250] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.910449] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.910582] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.910870] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.911037] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.911153] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.911359] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.911489] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.911664] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Resource: SegmentPort with ID: 0d74fda8-806f-4134-854d-9f7197ea9c5b is going to be created. [ 1234.927712] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.927944] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.928085] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.928317] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.928491] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.930217] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5149b744-44c8-4c79-817b-8ab2c5f59613 [ 1234.930434] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.930592] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.930676] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.930840] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.930944] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.931096] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5149b744-44c8-4c79-817b-8ab2c5f59613 already deleted. [ 1234.931168] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5149b744-44c8-4c79-817b-8ab2c5f59613" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.933804] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.934051] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.934202] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.934438] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.934659] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.934867] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "port-0d74fda8-806f-4134-854d-9f7197ea9c5b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.947900] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 846d69e3-9f9f-414f-912e-5a866002c853 in Status: IN_PROGRESS for 2s [ 1235.646273] env[65337]: INFO networking_nsxv3.common.synchronization [req-7327a91a-ef47-4b20-9f7f-ee72053fbf39 req-f415f507-a49c-4c82-8986-9a642e880809 service nova] Enqueued Resource ID: 5f51b41c-ca91-45cf-92a6-17398a529bbb with Priority: HIGHEST for action security_group_rules [ 1235.646600] env[65337]: INFO networking_nsxv3.common.synchronization [req-7327a91a-ef47-4b20-9f7f-ee72053fbf39 req-f415f507-a49c-4c82-8986-9a642e880809 service nova] Enqueued Resource ID: 5f51b41c-ca91-45cf-92a6-17398a529bbb with Priority: HIGHEST for action security_group_members [ 1235.646600] env[65337]: INFO networking_nsxv3.common.synchronization [req-7327a91a-ef47-4b20-9f7f-ee72053fbf39 req-f415f507-a49c-4c82-8986-9a642e880809 service nova] Enqueued Resource ID: 0d74fda8-806f-4134-854d-9f7197ea9c5b with Priority: HIGHEST for action port [ 1235.647192] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f51b41c-ca91-45cf-92a6-17398a529bbb with Priority: HIGHEST for action security_group_rules [ 1235.647285] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f51b41c-ca91-45cf-92a6-17398a529bbb with Priority: HIGHEST for action security_group_members [ 1235.647379] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d74fda8-806f-4134-854d-9f7197ea9c5b with Priority: HIGHEST for action port [ 1235.647697] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5f51b41c-ca91-45cf-92a6-17398a529bbb taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.647853] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5f51b41c-ca91-45cf-92a6-17398a529bbb" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.647916] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5f51b41c-ca91-45cf-92a6-17398a529bbb" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.648179] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5f51b41c-ca91-45cf-92a6-17398a529bbb" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.648263] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5f51b41c-ca91-45cf-92a6-17398a529bbb',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.649626] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f51b41c-ca91-45cf-92a6-17398a529bbb taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.650701] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f51b41c-ca91-45cf-92a6-17398a529bbb" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.650701] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-0d74fda8-806f-4134-854d-9f7197ea9c5b taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.650701] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0d74fda8-806f-4134-854d-9f7197ea9c5b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.650701] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0d74fda8-806f-4134-854d-9f7197ea9c5b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.650701] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0d74fda8-806f-4134-854d-9f7197ea9c5b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.650701] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0d74fda8-806f-4134-854d-9f7197ea9c5b',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.152633] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f51b41c-ca91-45cf-92a6-17398a529bbb taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.152855] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f51b41c-ca91-45cf-92a6-17398a529bbb" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.152944] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0d74fda8-806f-4134-854d-9f7197ea9c5b with status ACTIVE [ 1236.153150] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.153269] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.153336] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.153561] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.153656] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.153836] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.153986] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.153986] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.154157] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.154234] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.154443] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.154553] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.154645] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.154764] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.154841] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.154926] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0d74fda8-806f-4134-854d-9f7197ea9c5b is going to be updated. [ 1236.182420] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.182986] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.182986] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.183121] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.183266] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.183493] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0d74fda8-806f-4134-854d-9f7197ea9c5b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.596021] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f51b41c-ca91-45cf-92a6-17398a529bbb in Status: SUCCESS [ 1236.596269] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5f51b41c-ca91-45cf-92a6-17398a529bbb deletion is rescheduled due to dependency. [ 1236.596366] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f51b41c-ca91-45cf-92a6-17398a529bbb" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.596527] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f51b41c-ca91-45cf-92a6-17398a529bbb" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.596715] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f51b41c-ca91-45cf-92a6-17398a529bbb" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.596903] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.597047] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.597172] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.597243] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.597322] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.597414] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5f51b41c-ca91-45cf-92a6-17398a529bbb',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.966131] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 846d69e3-9f9f-414f-912e-5a866002c853 in Status: SUCCESS [ 1236.966551] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-846d69e3-9f9f-414f-912e-5a866002c853" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.099755] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5f51b41c-ca91-45cf-92a6-17398a529bbb',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1237.602316] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5f51b41c-ca91-45cf-92a6-17398a529bbb',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1238.105361] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.105750] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.105750] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.105750] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.105910] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.105951] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5f51b41c-ca91-45cf-92a6-17398a529bbb is going to be updated. [ 1238.139324] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.139474] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.139680] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.139923] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.140113] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.149785] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f51b41c-ca91-45cf-92a6-17398a529bbb in Status: IN_PROGRESS for 2s [ 1238.326686] env[65337]: INFO networking_nsxv3.common.synchronization [req-3d6f086b-fe38-45db-8d98-b9668e644aca req-8822a1f4-9521-4545-a13c-0c52bf1ebc5b tempest-ListServersNegativeTestJSON-458152726 tempest-ListServersNegativeTestJSON-458152726-project-member] Enqueued Resource ID: 65bdf164-5da2-4e67-8ed6-85fb2021a359 with Priority: HIGHEST for action security_group_members [ 1238.327298] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65bdf164-5da2-4e67-8ed6-85fb2021a359 with Priority: HIGHEST for action security_group_members [ 1238.327587] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-65bdf164-5da2-4e67-8ed6-85fb2021a359 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.327716] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-65bdf164-5da2-4e67-8ed6-85fb2021a359" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.327775] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-65bdf164-5da2-4e67-8ed6-85fb2021a359" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.328181] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-65bdf164-5da2-4e67-8ed6-85fb2021a359" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.328389] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.328500] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.328556] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.328712] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.328804] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.328897] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('65bdf164-5da2-4e67-8ed6-85fb2021a359',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1238.649639] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock network-559 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.649867] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "network-559" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.650012] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "network-559" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.650356] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "network-559" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.650706] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.650913] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.651062] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.651312] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.651464] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.651690] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1238.651825] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1238.651942] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1238.652077] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1238.652205] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1238.652359] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1238.652457] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1238.673414] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1238.673590] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1238.673725] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1238.673905] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "network-559" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.674237] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock port-b475c66b-8124-407d-87f3-7d45557a42f5 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.674438] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "port-b475c66b-8124-407d-87f3-7d45557a42f5" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.674607] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "port-b475c66b-8124-407d-87f3-7d45557a42f5" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.674936] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "port-b475c66b-8124-407d-87f3-7d45557a42f5" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.675087] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b475c66b-8124-407d-87f3-7d45557a42f5',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1238.830768] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.830943] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.830943] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.831201] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.831393] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.831479] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.831583] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.831652] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.831753] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.831840] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.831965] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 65bdf164-5da2-4e67-8ed6-85fb2021a359 already deleted. [ 1238.832136] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-65bdf164-5da2-4e67-8ed6-85fb2021a359" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.178195] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.178585] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.178696] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.179058] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.179276] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.179482] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Segment Port b475c66b-8124-407d-87f3-7d45557a42f5 not found, creating... [ 1239.179850] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.180079] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.180263] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.180644] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.180829] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.181846] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.181846] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.181846] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.181846] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.182144] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.182144] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Resource: SegmentPort with ID: b475c66b-8124-407d-87f3-7d45557a42f5 is going to be created. [ 1239.207546] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.207901] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.208113] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.208438] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.208758] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.209080] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "port-b475c66b-8124-407d-87f3-7d45557a42f5" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.631512] env[65337]: INFO networking_nsxv3.common.synchronization [req-07762bdd-7ac0-4716-977d-d8b4166c630d req-2d8b3ed3-f9ea-4be7-96d8-218b4ef27906 tempest-ServerPasswordTestJSON-927370012 tempest-ServerPasswordTestJSON-927370012-project-member] Enqueued Resource ID: 9c4e6dd2-ce42-4c12-a876-a0055bfa44f3 with Priority: HIGHEST for action security_group_members [ 1239.632087] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c4e6dd2-ce42-4c12-a876-a0055bfa44f3 with Priority: HIGHEST for action security_group_members [ 1239.632469] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c4e6dd2-ce42-4c12-a876-a0055bfa44f3 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.632619] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c4e6dd2-ce42-4c12-a876-a0055bfa44f3" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.632753] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c4e6dd2-ce42-4c12-a876-a0055bfa44f3" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.632962] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c4e6dd2-ce42-4c12-a876-a0055bfa44f3" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.633137] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.633241] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.633304] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.633454] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.633533] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.633629] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9c4e6dd2-ce42-4c12-a876-a0055bfa44f3',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.908952] env[65337]: INFO networking_nsxv3.common.synchronization [req-3d6f086b-fe38-45db-8d98-b9668e644aca req-2f8ce1df-8cb0-42a1-bdea-89bc91e866fb service nova] Enqueued Resource ID: 65bdf164-5da2-4e67-8ed6-85fb2021a359 with Priority: HIGHEST for action security_group_rules [ 1239.909120] env[65337]: INFO networking_nsxv3.common.synchronization [req-3d6f086b-fe38-45db-8d98-b9668e644aca req-2f8ce1df-8cb0-42a1-bdea-89bc91e866fb service nova] Enqueued Resource ID: 65bdf164-5da2-4e67-8ed6-85fb2021a359 with Priority: HIGHEST for action security_group_members [ 1239.909321] env[65337]: INFO networking_nsxv3.common.synchronization [req-3d6f086b-fe38-45db-8d98-b9668e644aca req-2f8ce1df-8cb0-42a1-bdea-89bc91e866fb service nova] Enqueued Resource ID: b475c66b-8124-407d-87f3-7d45557a42f5 with Priority: HIGHEST for action port [ 1239.909831] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65bdf164-5da2-4e67-8ed6-85fb2021a359 with Priority: HIGHEST for action security_group_rules [ 1239.909967] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65bdf164-5da2-4e67-8ed6-85fb2021a359 with Priority: HIGHEST for action security_group_members [ 1239.911205] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b475c66b-8124-407d-87f3-7d45557a42f5 with Priority: HIGHEST for action port [ 1239.911555] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-65bdf164-5da2-4e67-8ed6-85fb2021a359 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.911847] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-65bdf164-5da2-4e67-8ed6-85fb2021a359" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.911847] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-65bdf164-5da2-4e67-8ed6-85fb2021a359" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.912067] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-65bdf164-5da2-4e67-8ed6-85fb2021a359" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.912182] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('65bdf164-5da2-4e67-8ed6-85fb2021a359',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.914242] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-65bdf164-5da2-4e67-8ed6-85fb2021a359 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.914334] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-65bdf164-5da2-4e67-8ed6-85fb2021a359" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.914381] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-65bdf164-5da2-4e67-8ed6-85fb2021a359" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.915319] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-65bdf164-5da2-4e67-8ed6-85fb2021a359" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.915319] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.915319] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.915319] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.915319] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.915319] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.915656] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('65bdf164-5da2-4e67-8ed6-85fb2021a359',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.916819] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-b475c66b-8124-407d-87f3-7d45557a42f5 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.916819] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b475c66b-8124-407d-87f3-7d45557a42f5" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.916819] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b475c66b-8124-407d-87f3-7d45557a42f5" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.917031] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b475c66b-8124-407d-87f3-7d45557a42f5" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.917031] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b475c66b-8124-407d-87f3-7d45557a42f5',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.135673] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.135771] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.135869] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.136071] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.136171] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.136381] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.136523] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.136612] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.136727] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.136801] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.136888] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9c4e6dd2-ce42-4c12-a876-a0055bfa44f3 is going to be updated. [ 1240.160642] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f51b41c-ca91-45cf-92a6-17398a529bbb in Status: SUCCESS [ 1240.160911] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f51b41c-ca91-45cf-92a6-17398a529bbb" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.161130] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f51b41c-ca91-45cf-92a6-17398a529bbb" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.161454] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f51b41c-ca91-45cf-92a6-17398a529bbb" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.161709] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.161796] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.162693] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.162693] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.162693] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.162693] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f51b41c-ca91-45cf-92a6-17398a529bbb" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.162693] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5f51b41c-ca91-45cf-92a6-17398a529bbb',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.171436] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.171664] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.171765] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.171985] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.172171] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.183021] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9c4e6dd2-ce42-4c12-a876-a0055bfa44f3 in Status: IN_PROGRESS for 2s [ 1240.419549] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-65bdf164-5da2-4e67-8ed6-85fb2021a359 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.419549] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-65bdf164-5da2-4e67-8ed6-85fb2021a359" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.419549] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('65bdf164-5da2-4e67-8ed6-85fb2021a359',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.421637] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b475c66b-8124-407d-87f3-7d45557a42f5 with status ACTIVE [ 1240.421637] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.421637] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.421827] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.421921] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.421958] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.422630] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.423678] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.423678] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.423901] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.423901] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.424072] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.424160] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.424209] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.424326] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.424392] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.424564] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b475c66b-8124-407d-87f3-7d45557a42f5 is going to be updated. [ 1240.448420] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.448596] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.448643] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.448890] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.449058] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.449227] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b475c66b-8124-407d-87f3-7d45557a42f5" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.664841] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5f51b41c-ca91-45cf-92a6-17398a529bbb',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.705216] env[65337]: INFO networking_nsxv3.common.synchronization [req-3d6f086b-fe38-45db-8d98-b9668e644aca req-1cd07888-bfcd-4791-8dd2-c992ab109171 tempest-ListServersNegativeTestJSON-458152726 tempest-ListServersNegativeTestJSON-458152726-project-member] Enqueued Resource ID: 65bdf164-5da2-4e67-8ed6-85fb2021a359 with Priority: HIGHEST for action security_group_members [ 1240.705557] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65bdf164-5da2-4e67-8ed6-85fb2021a359 with Priority: HIGHEST for action security_group_members [ 1240.706090] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-65bdf164-5da2-4e67-8ed6-85fb2021a359 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.706198] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-65bdf164-5da2-4e67-8ed6-85fb2021a359" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.927110] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('65bdf164-5da2-4e67-8ed6-85fb2021a359',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.976892] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock network-559 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.977283] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "network-559" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.977378] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "network-559" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.977791] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "network-559" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.978113] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.978336] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.978815] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.978815] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.978955] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.979178] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1240.979257] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1240.980160] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1240.980160] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1240.980160] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1240.980160] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1240.980160] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1241.002633] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1241.002800] env[65337]: DEBUG dogpile.cache.region [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1241.002949] env[65337]: DEBUG dogpile.lock [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1241.003151] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "network-559" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.003483] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock port-8ca2f6c0-d6b3-4802-a3f9-5cf23d11cb9c taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.003672] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "port-8ca2f6c0-d6b3-4802-a3f9-5cf23d11cb9c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.003840] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "port-8ca2f6c0-d6b3-4802-a3f9-5cf23d11cb9c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.004949] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "port-8ca2f6c0-d6b3-4802-a3f9-5cf23d11cb9c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.005777] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8ca2f6c0-d6b3-4802-a3f9-5cf23d11cb9c',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.166857] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5f51b41c-ca91-45cf-92a6-17398a529bbb: rpc.has_security_group_logging(os_id): False [ 1241.188496] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.188789] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.188789] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.188962] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.189079] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.189292] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.189393] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.189455] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.189625] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.189709] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.189798] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5f51b41c-ca91-45cf-92a6-17398a529bbb is going to be updated. [ 1241.256957] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.257155] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.257336] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.257476] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.257635] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.272469] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5f51b41c-ca91-45cf-92a6-17398a529bbb in Status: IN_PROGRESS for 2s [ 1241.431878] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.432219] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.432313] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.432535] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.432622] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.432784] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 65bdf164-5da2-4e67-8ed6-85fb2021a359 is going to be created. [ 1241.457874] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.458195] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.458195] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.458377] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.458519] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.468511] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 65bdf164-5da2-4e67-8ed6-85fb2021a359 in Status: UNINITIALIZED for 2s [ 1241.509179] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.509526] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.509838] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.509942] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.510131] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.510310] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Segment Port 8ca2f6c0-d6b3-4802-a3f9-5cf23d11cb9c not found, creating... [ 1241.510589] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.510776] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.510898] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.511149] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.511294] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.511619] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.511800] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.511928] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.512177] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.512310] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.512470] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Resource: SegmentPort with ID: 8ca2f6c0-d6b3-4802-a3f9-5cf23d11cb9c is going to be created. [ 1241.535396] env[65337]: DEBUG networking_nsxv3.common.locking [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.535727] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.535727] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.536045] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.536382] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.536817] env[65337]: DEBUG oslo_concurrency.lockutils [None req-df07061e-dd16-4bcd-ae52-c6bc0bb1f3fc None None] Releasing lock "port-8ca2f6c0-d6b3-4802-a3f9-5cf23d11cb9c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.194539] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9c4e6dd2-ce42-4c12-a876-a0055bfa44f3 in Status: SUCCESS [ 1242.194840] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9c4e6dd2-ce42-4c12-a876-a0055bfa44f3 deletion is rescheduled due to dependency. [ 1242.194840] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c4e6dd2-ce42-4c12-a876-a0055bfa44f3" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.319152] env[65337]: INFO networking_nsxv3.common.synchronization [req-3d6f086b-fe38-45db-8d98-b9668e644aca req-250d55be-3fca-401f-a882-ff0105fb3707 service nova] Enqueued Resource ID: 65bdf164-5da2-4e67-8ed6-85fb2021a359 with Priority: HIGHEST for action security_group_rules [ 1242.319152] env[65337]: INFO networking_nsxv3.common.synchronization [req-3d6f086b-fe38-45db-8d98-b9668e644aca req-250d55be-3fca-401f-a882-ff0105fb3707 service nova] Enqueued Resource ID: 65bdf164-5da2-4e67-8ed6-85fb2021a359 with Priority: HIGHEST for action security_group_members [ 1242.319152] env[65337]: INFO networking_nsxv3.common.synchronization [req-3d6f086b-fe38-45db-8d98-b9668e644aca req-250d55be-3fca-401f-a882-ff0105fb3707 service nova] Enqueued Resource ID: 8ca2f6c0-d6b3-4802-a3f9-5cf23d11cb9c with Priority: HIGHEST for action port [ 1242.320959] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65bdf164-5da2-4e67-8ed6-85fb2021a359 with Priority: HIGHEST for action security_group_rules [ 1242.321265] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65bdf164-5da2-4e67-8ed6-85fb2021a359 with Priority: HIGHEST for action security_group_members [ 1242.321533] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ca2f6c0-d6b3-4802-a3f9-5cf23d11cb9c with Priority: HIGHEST for action port [ 1242.322237] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-65bdf164-5da2-4e67-8ed6-85fb2021a359 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.322489] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-65bdf164-5da2-4e67-8ed6-85fb2021a359" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.322918] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-65bdf164-5da2-4e67-8ed6-85fb2021a359 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.323132] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-65bdf164-5da2-4e67-8ed6-85fb2021a359" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.323776] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-8ca2f6c0-d6b3-4802-a3f9-5cf23d11cb9c taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.324089] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8ca2f6c0-d6b3-4802-a3f9-5cf23d11cb9c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.324249] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8ca2f6c0-d6b3-4802-a3f9-5cf23d11cb9c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.324537] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8ca2f6c0-d6b3-4802-a3f9-5cf23d11cb9c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.324714] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8ca2f6c0-d6b3-4802-a3f9-5cf23d11cb9c',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1242.827586] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8ca2f6c0-d6b3-4802-a3f9-5cf23d11cb9c with status ACTIVE [ 1242.827829] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.828033] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.828112] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.828320] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.828412] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.828587] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.828686] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.828745] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.828918] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.829166] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.829375] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.829528] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.829595] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.829729] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.829763] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.829845] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8ca2f6c0-d6b3-4802-a3f9-5cf23d11cb9c is going to be updated. [ 1242.852888] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.853062] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.853124] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.853467] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.853467] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.853601] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8ca2f6c0-d6b3-4802-a3f9-5cf23d11cb9c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.076560] env[65337]: INFO networking_nsxv3.common.synchronization [req-3d6f086b-fe38-45db-8d98-b9668e644aca req-bd9fde49-d45d-40bf-8e8a-7d24622f5ce4 tempest-ListServersNegativeTestJSON-458152726 tempest-ListServersNegativeTestJSON-458152726-project-member] Enqueued Resource ID: 65bdf164-5da2-4e67-8ed6-85fb2021a359 with Priority: HIGHEST for action security_group_members [ 1243.077150] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65bdf164-5da2-4e67-8ed6-85fb2021a359 with Priority: HIGHEST for action security_group_members [ 1243.077457] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-65bdf164-5da2-4e67-8ed6-85fb2021a359 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.077558] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-65bdf164-5da2-4e67-8ed6-85fb2021a359" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.284951] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5f51b41c-ca91-45cf-92a6-17398a529bbb in Status: SUCCESS [ 1243.285230] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5f51b41c-ca91-45cf-92a6-17398a529bbb" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.401347] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock network-559 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.402454] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "network-559" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.402454] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "network-559" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.402454] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "network-559" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.403340] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.404196] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.404196] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.404344] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.404568] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.404972] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1243.405175] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1243.405363] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1243.405541] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1243.405704] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1243.405884] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1243.406111] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1243.426519] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1243.426735] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1243.426911] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1243.427126] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "network-559" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.427502] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock port-d1a09256-b76b-42c0-9d64-be1b26906586 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.427683] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "port-d1a09256-b76b-42c0-9d64-be1b26906586" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.427860] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "port-d1a09256-b76b-42c0-9d64-be1b26906586" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.428259] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "port-d1a09256-b76b-42c0-9d64-be1b26906586" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.428424] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d1a09256-b76b-42c0-9d64-be1b26906586',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.479576] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 65bdf164-5da2-4e67-8ed6-85fb2021a359 in Status: SUCCESS [ 1243.479831] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-65bdf164-5da2-4e67-8ed6-85fb2021a359" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.479995] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-65bdf164-5da2-4e67-8ed6-85fb2021a359" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.480242] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-65bdf164-5da2-4e67-8ed6-85fb2021a359" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.480440] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.480557] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.480625] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.480762] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.480844] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.480927] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-65bdf164-5da2-4e67-8ed6-85fb2021a359" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.481034] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('65bdf164-5da2-4e67-8ed6-85fb2021a359',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.483779] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-65bdf164-5da2-4e67-8ed6-85fb2021a359" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.485031] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-65bdf164-5da2-4e67-8ed6-85fb2021a359" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.485031] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.485031] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.485031] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.485031] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.485031] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.485031] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('65bdf164-5da2-4e67-8ed6-85fb2021a359',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.931484] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.931808] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.931973] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.932364] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.932581] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.932754] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Segment Port d1a09256-b76b-42c0-9d64-be1b26906586 not found, creating... [ 1243.933049] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.933213] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.933331] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.933556] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.933693] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.933971] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.934267] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.934267] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.934580] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.934580] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.934771] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Resource: SegmentPort with ID: d1a09256-b76b-42c0-9d64-be1b26906586 is going to be created. [ 1243.958890] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.959206] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.959322] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.959722] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.959918] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.960208] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "port-d1a09256-b76b-42c0-9d64-be1b26906586" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.987180] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-65bdf164-5da2-4e67-8ed6-85fb2021a359 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.987393] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-65bdf164-5da2-4e67-8ed6-85fb2021a359" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.987536] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('65bdf164-5da2-4e67-8ed6-85fb2021a359',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.490225] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('65bdf164-5da2-4e67-8ed6-85fb2021a359',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.685326] env[65337]: INFO networking_nsxv3.common.synchronization [req-3d6f086b-fe38-45db-8d98-b9668e644aca req-9919c3fd-d69a-486a-b0c9-75c6828c07ae service nova] Enqueued Resource ID: 65bdf164-5da2-4e67-8ed6-85fb2021a359 with Priority: HIGHEST for action security_group_rules [ 1244.685593] env[65337]: INFO networking_nsxv3.common.synchronization [req-3d6f086b-fe38-45db-8d98-b9668e644aca req-9919c3fd-d69a-486a-b0c9-75c6828c07ae service nova] Enqueued Resource ID: 65bdf164-5da2-4e67-8ed6-85fb2021a359 with Priority: HIGHEST for action security_group_members [ 1244.685814] env[65337]: INFO networking_nsxv3.common.synchronization [req-3d6f086b-fe38-45db-8d98-b9668e644aca req-9919c3fd-d69a-486a-b0c9-75c6828c07ae service nova] Enqueued Resource ID: d1a09256-b76b-42c0-9d64-be1b26906586 with Priority: HIGHEST for action port [ 1244.686422] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65bdf164-5da2-4e67-8ed6-85fb2021a359 with Priority: HIGHEST for action security_group_rules [ 1244.686667] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65bdf164-5da2-4e67-8ed6-85fb2021a359 with Priority: HIGHEST for action security_group_members [ 1244.686779] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1a09256-b76b-42c0-9d64-be1b26906586 with Priority: HIGHEST for action port [ 1244.687092] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-65bdf164-5da2-4e67-8ed6-85fb2021a359 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.687196] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-65bdf164-5da2-4e67-8ed6-85fb2021a359" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.687397] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-65bdf164-5da2-4e67-8ed6-85fb2021a359 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.687478] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-65bdf164-5da2-4e67-8ed6-85fb2021a359" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.687647] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-d1a09256-b76b-42c0-9d64-be1b26906586 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.687738] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d1a09256-b76b-42c0-9d64-be1b26906586" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.687828] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d1a09256-b76b-42c0-9d64-be1b26906586" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.687998] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d1a09256-b76b-42c0-9d64-be1b26906586" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.688079] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d1a09256-b76b-42c0-9d64-be1b26906586',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.993286] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.993438] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.993438] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.994257] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.994257] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.994257] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 65bdf164-5da2-4e67-8ed6-85fb2021a359 is going to be updated. [ 1245.028878] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.028878] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.029112] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.029412] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.029719] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.043021] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 65bdf164-5da2-4e67-8ed6-85fb2021a359 in Status: IN_PROGRESS for 2s [ 1245.190014] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d1a09256-b76b-42c0-9d64-be1b26906586 with status ACTIVE [ 1245.190233] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.190369] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.190455] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.190851] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.190851] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.190975] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.191035] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.191084] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.191232] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.191304] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.191571] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.191683] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.191725] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.191866] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.191929] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.192024] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d1a09256-b76b-42c0-9d64-be1b26906586 is going to be updated. [ 1245.214023] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.214198] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.214237] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.214441] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.214609] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.214941] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d1a09256-b76b-42c0-9d64-be1b26906586" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.058644] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 65bdf164-5da2-4e67-8ed6-85fb2021a359 in Status: SUCCESS [ 1247.059116] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-65bdf164-5da2-4e67-8ed6-85fb2021a359" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.059116] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-65bdf164-5da2-4e67-8ed6-85fb2021a359" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.059669] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-65bdf164-5da2-4e67-8ed6-85fb2021a359" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.059719] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.059872] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.059965] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.060230] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.060418] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.060512] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('65bdf164-5da2-4e67-8ed6-85fb2021a359',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1247.564598] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('65bdf164-5da2-4e67-8ed6-85fb2021a359',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.066412] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('65bdf164-5da2-4e67-8ed6-85fb2021a359',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.570081] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.570081] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.570081] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.570081] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.570081] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.570081] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 65bdf164-5da2-4e67-8ed6-85fb2021a359 is going to be updated. [ 1248.603284] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.603499] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.603588] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.603794] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.603955] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.615205] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 65bdf164-5da2-4e67-8ed6-85fb2021a359 in Status: IN_PROGRESS for 2s [ 1248.626918] env[65337]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-f81d39ac-7b08-4c21-a1c2-6484bc6252df None None] NSXv3 Agent Agent loop - iteration:2 completed [ 1248.627190] env[65337]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-f81d39ac-7b08-4c21-a1c2-6484bc6252df None None] NSXv3 Agent Agent loop - iteration:3 started [ 1249.587345] env[65337]: INFO networking_nsxv3.common.synchronization [None req-b235b2e5-3d12-4bc7-a069-8b6535b695b7 tempest-AttachVolumeNegativeTest-935303807 tempest-AttachVolumeNegativeTest-935303807-project-member] Enqueued Resource ID: c043a4b4-c94d-40e1-ad4b-77d54e25a156 with Priority: HIGHEST for action security_group_rules [ 1249.588073] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c043a4b4-c94d-40e1-ad4b-77d54e25a156 with Priority: HIGHEST for action security_group_rules [ 1249.588431] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c043a4b4-c94d-40e1-ad4b-77d54e25a156 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.588561] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c043a4b4-c94d-40e1-ad4b-77d54e25a156" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.588637] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c043a4b4-c94d-40e1-ad4b-77d54e25a156" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.589065] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c043a4b4-c94d-40e1-ad4b-77d54e25a156" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.589176] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c043a4b4-c94d-40e1-ad4b-77d54e25a156',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.678603] env[65337]: INFO networking_nsxv3.common.synchronization [None req-985e6846-391f-4b87-b552-6d0c9338329d tempest-AttachVolumeNegativeTest-935303807 tempest-AttachVolumeNegativeTest-935303807-project-member] Enqueued Resource ID: c043a4b4-c94d-40e1-ad4b-77d54e25a156 with Priority: HIGHEST for action security_group_rules [ 1249.678964] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c043a4b4-c94d-40e1-ad4b-77d54e25a156 with Priority: HIGHEST for action security_group_rules [ 1249.679405] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c043a4b4-c94d-40e1-ad4b-77d54e25a156 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.679553] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c043a4b4-c94d-40e1-ad4b-77d54e25a156" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.110259] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.110443] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.110516] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.110683] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.110764] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.110879] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c043a4b4-c94d-40e1-ad4b-77d54e25a156 already deleted. [ 1250.110946] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c043a4b4-c94d-40e1-ad4b-77d54e25a156" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.111091] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c043a4b4-c94d-40e1-ad4b-77d54e25a156" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.111265] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c043a4b4-c94d-40e1-ad4b-77d54e25a156" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.111350] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c043a4b4-c94d-40e1-ad4b-77d54e25a156',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.627151] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 65bdf164-5da2-4e67-8ed6-85fb2021a359 in Status: SUCCESS [ 1250.627858] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-65bdf164-5da2-4e67-8ed6-85fb2021a359" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.627858] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-65bdf164-5da2-4e67-8ed6-85fb2021a359" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.627858] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-65bdf164-5da2-4e67-8ed6-85fb2021a359" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.628299] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.628299] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.628299] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.628548] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.628548] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.628548] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('65bdf164-5da2-4e67-8ed6-85fb2021a359',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.639026] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.639177] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.639177] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.639390] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.639538] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.639586] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c043a4b4-c94d-40e1-ad4b-77d54e25a156 already deleted. [ 1250.639743] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c043a4b4-c94d-40e1-ad4b-77d54e25a156" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.130833] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('65bdf164-5da2-4e67-8ed6-85fb2021a359',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1251.634488] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('65bdf164-5da2-4e67-8ed6-85fb2021a359',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.136198] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.136514] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.136704] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.137369] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.137369] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.137369] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 65bdf164-5da2-4e67-8ed6-85fb2021a359 is going to be updated. [ 1252.168749] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.169064] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.169140] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.169396] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.169555] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.183056] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 65bdf164-5da2-4e67-8ed6-85fb2021a359 in Status: IN_PROGRESS for 2s [ 1252.685184] env[65337]: INFO networking_nsxv3.common.synchronization [req-93b88152-9ce5-40d0-88d3-6b19a345d466 req-d2b6e0c2-f970-47c9-b606-2bd0d0add6dd tempest-AttachVolumeTestJSON-1666012690 tempest-AttachVolumeTestJSON-1666012690-project-member] Enqueued Resource ID: 6d469e76-9ef3-431d-9a07-dc20e79dbd4e with Priority: HIGHEST for action security_group_members [ 1252.685837] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d469e76-9ef3-431d-9a07-dc20e79dbd4e with Priority: HIGHEST for action security_group_members [ 1252.686334] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d469e76-9ef3-431d-9a07-dc20e79dbd4e taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.686416] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d469e76-9ef3-431d-9a07-dc20e79dbd4e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.686497] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d469e76-9ef3-431d-9a07-dc20e79dbd4e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.686750] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d469e76-9ef3-431d-9a07-dc20e79dbd4e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.686990] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.687144] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.687215] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.687384] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.687489] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.687607] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d469e76-9ef3-431d-9a07-dc20e79dbd4e',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.189688] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.189916] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.190135] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.190400] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.190528] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.190688] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.190830] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.190895] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.191072] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.191205] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.191309] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d469e76-9ef3-431d-9a07-dc20e79dbd4e is going to be updated. [ 1253.220398] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.220398] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.220398] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.220398] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.220398] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.232309] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d469e76-9ef3-431d-9a07-dc20e79dbd4e in Status: IN_PROGRESS for 2s [ 1254.198344] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 65bdf164-5da2-4e67-8ed6-85fb2021a359 in Status: SUCCESS [ 1254.198718] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-65bdf164-5da2-4e67-8ed6-85fb2021a359" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.198943] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-65bdf164-5da2-4e67-8ed6-85fb2021a359" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.199294] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-65bdf164-5da2-4e67-8ed6-85fb2021a359" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.199584] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.199764] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.199893] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.200183] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.200326] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.200481] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-65bdf164-5da2-4e67-8ed6-85fb2021a359" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.200767] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-65bdf164-5da2-4e67-8ed6-85fb2021a359 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.200918] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-65bdf164-5da2-4e67-8ed6-85fb2021a359" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.201041] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-65bdf164-5da2-4e67-8ed6-85fb2021a359" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.201290] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-65bdf164-5da2-4e67-8ed6-85fb2021a359" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.201547] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.201733] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.201845] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.202081] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.202212] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.202347] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-65bdf164-5da2-4e67-8ed6-85fb2021a359" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.202466] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('65bdf164-5da2-4e67-8ed6-85fb2021a359',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1254.203996] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-65bdf164-5da2-4e67-8ed6-85fb2021a359" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.203996] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-65bdf164-5da2-4e67-8ed6-85fb2021a359" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.203996] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.204226] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.204226] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.204392] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.204495] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.204615] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('65bdf164-5da2-4e67-8ed6-85fb2021a359',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1254.706874] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 65bdf164-5da2-4e67-8ed6-85fb2021a359: rpc.has_security_group_logging(os_id): False [ 1254.707792] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('65bdf164-5da2-4e67-8ed6-85fb2021a359',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1254.725973] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.726162] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.726211] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.726401] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.726483] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.726737] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.726840] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.726889] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.727099] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.727398] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.727398] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.727521] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.727521] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.727678] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.727781] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.727986] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.728119] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.728180] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.728324] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.728396] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.728478] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 65bdf164-5da2-4e67-8ed6-85fb2021a359 is going to be created. [ 1254.785372] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.785602] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.785602] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.785816] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.786065] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.799543] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 65bdf164-5da2-4e67-8ed6-85fb2021a359 in Status: IN_PROGRESS for 2s [ 1255.210778] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('65bdf164-5da2-4e67-8ed6-85fb2021a359',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.242812] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d469e76-9ef3-431d-9a07-dc20e79dbd4e in Status: SUCCESS [ 1255.243026] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d469e76-9ef3-431d-9a07-dc20e79dbd4e deletion is rescheduled due to dependency. [ 1255.243129] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d469e76-9ef3-431d-9a07-dc20e79dbd4e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.714182] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.714182] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.714182] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.714414] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.714522] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.714630] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 65bdf164-5da2-4e67-8ed6-85fb2021a359 is going to be updated. [ 1255.756305] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.756536] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.756677] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.756851] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.757047] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.767625] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 65bdf164-5da2-4e67-8ed6-85fb2021a359 in Status: IN_PROGRESS for 2s [ 1256.262331] env[65337]: INFO networking_nsxv3.common.synchronization [req-6ace0168-1830-4ac3-a641-ba05a3736ef7 req-ebb46202-f797-4205-9e09-0759242bde5c tempest-AttachVolumeNegativeTest-935303807 tempest-AttachVolumeNegativeTest-935303807-project-member] Enqueued Resource ID: c043a4b4-c94d-40e1-ad4b-77d54e25a156 with Priority: HIGHEST for action security_group_members [ 1256.263042] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c043a4b4-c94d-40e1-ad4b-77d54e25a156 with Priority: HIGHEST for action security_group_members [ 1256.263227] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-c043a4b4-c94d-40e1-ad4b-77d54e25a156 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.263374] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c043a4b4-c94d-40e1-ad4b-77d54e25a156" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.263459] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c043a4b4-c94d-40e1-ad4b-77d54e25a156" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.263741] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c043a4b4-c94d-40e1-ad4b-77d54e25a156" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.263911] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.264036] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.264094] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.264544] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.264544] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.264544] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c043a4b4-c94d-40e1-ad4b-77d54e25a156',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.562492] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock network-61 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.562712] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "network-61" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.562835] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "network-61" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.563123] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "network-61" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.563384] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.563540] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.563676] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.563908] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.564064] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.564451] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1256.564625] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1256.564771] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1256.564887] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1256.565065] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1256.565147] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1256.565284] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1256.584577] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1256.584747] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1256.584886] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1256.585078] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "network-61" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.585402] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock port-be43121c-5ee9-4303-a5f8-74c977cbaddd taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.585574] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "port-be43121c-5ee9-4303-a5f8-74c977cbaddd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.585709] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "port-be43121c-5ee9-4303-a5f8-74c977cbaddd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.586044] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "port-be43121c-5ee9-4303-a5f8-74c977cbaddd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.586188] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('be43121c-5ee9-4303-a5f8-74c977cbaddd',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.766388] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.766600] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.766676] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.766897] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.766985] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.767197] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.767296] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.767355] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.767497] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.767594] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.767689] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c043a4b4-c94d-40e1-ad4b-77d54e25a156 already deleted. [ 1256.767774] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c043a4b4-c94d-40e1-ad4b-77d54e25a156" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.814080] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 65bdf164-5da2-4e67-8ed6-85fb2021a359 in Status: SUCCESS [ 1256.814080] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-65bdf164-5da2-4e67-8ed6-85fb2021a359" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.814080] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-65bdf164-5da2-4e67-8ed6-85fb2021a359" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.815024] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-65bdf164-5da2-4e67-8ed6-85fb2021a359" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.815141] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('65bdf164-5da2-4e67-8ed6-85fb2021a359',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.838333] env[65337]: INFO networking_nsxv3.common.synchronization [req-44a5453d-c9d1-47de-af74-be58da876cfe req-86c6cf94-3962-46ed-b7ff-c1c945455f0f tempest-ListServersNegativeTestJSON-458152726 tempest-ListServersNegativeTestJSON-458152726-project-member] Enqueued Resource ID: 65bdf164-5da2-4e67-8ed6-85fb2021a359 with Priority: HIGHEST for action security_group_members [ 1256.838806] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65bdf164-5da2-4e67-8ed6-85fb2021a359 with Priority: HIGHEST for action security_group_members [ 1256.840770] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-65bdf164-5da2-4e67-8ed6-85fb2021a359 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.840770] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-65bdf164-5da2-4e67-8ed6-85fb2021a359" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.071588] env[65337]: INFO networking_nsxv3.common.synchronization [None req-d662fd0f-eee0-40a8-87eb-1ff8bd933065 tempest-ServerRescueNegativeTestJSON-59296460 tempest-ServerRescueNegativeTestJSON-59296460-project-member] Enqueued Resource ID: 303cb78d-3c85-4fcc-964c-f1082480bdd7 with Priority: HIGHEST for action security_group_rules [ 1257.072657] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 303cb78d-3c85-4fcc-964c-f1082480bdd7 with Priority: HIGHEST for action security_group_rules [ 1257.073254] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-303cb78d-3c85-4fcc-964c-f1082480bdd7 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.073450] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-303cb78d-3c85-4fcc-964c-f1082480bdd7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.073565] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-303cb78d-3c85-4fcc-964c-f1082480bdd7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.073923] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-303cb78d-3c85-4fcc-964c-f1082480bdd7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.074060] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('303cb78d-3c85-4fcc-964c-f1082480bdd7',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.088594] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.088788] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.089062] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.089393] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.089393] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.089531] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Segment Port be43121c-5ee9-4303-a5f8-74c977cbaddd not found, creating... [ 1257.089896] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.090076] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.090196] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.090420] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.090560] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.090853] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.091224] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.091400] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.091648] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.091793] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.092135] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Resource: SegmentPort with ID: be43121c-5ee9-4303-a5f8-74c977cbaddd is going to be created. [ 1257.155390] env[65337]: INFO networking_nsxv3.common.synchronization [None req-e2a14130-d81f-46a0-b119-36e1b304f7bd tempest-ServerRescueNegativeTestJSON-59296460 tempest-ServerRescueNegativeTestJSON-59296460-project-member] Enqueued Resource ID: 303cb78d-3c85-4fcc-964c-f1082480bdd7 with Priority: HIGHEST for action security_group_rules [ 1257.156044] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 303cb78d-3c85-4fcc-964c-f1082480bdd7 with Priority: HIGHEST for action security_group_rules [ 1257.156380] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-303cb78d-3c85-4fcc-964c-f1082480bdd7 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.156488] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-303cb78d-3c85-4fcc-964c-f1082480bdd7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.201647] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.201887] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.202022] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.202466] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.202558] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.203085] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "port-be43121c-5ee9-4303-a5f8-74c977cbaddd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.317222] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-65bdf164-5da2-4e67-8ed6-85fb2021a359 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.317633] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-65bdf164-5da2-4e67-8ed6-85fb2021a359" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.596936] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.597291] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.597368] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.597644] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.597777] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.597922] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 303cb78d-3c85-4fcc-964c-f1082480bdd7 already deleted. [ 1257.598052] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-303cb78d-3c85-4fcc-964c-f1082480bdd7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.598721] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-303cb78d-3c85-4fcc-964c-f1082480bdd7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.599063] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-303cb78d-3c85-4fcc-964c-f1082480bdd7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.599250] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('303cb78d-3c85-4fcc-964c-f1082480bdd7',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.778825] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 65bdf164-5da2-4e67-8ed6-85fb2021a359 in Status: SUCCESS [ 1257.778825] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-65bdf164-5da2-4e67-8ed6-85fb2021a359" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.778825] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-65bdf164-5da2-4e67-8ed6-85fb2021a359" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.778825] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-65bdf164-5da2-4e67-8ed6-85fb2021a359" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.778825] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.778825] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.778825] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.779223] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.779223] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.779223] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('65bdf164-5da2-4e67-8ed6-85fb2021a359',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.847866] env[65337]: INFO networking_nsxv3.common.synchronization [req-6ace0168-1830-4ac3-a641-ba05a3736ef7 req-86abfe7b-3ed1-4778-a2d5-8448c577649b service nova] Enqueued Resource ID: c043a4b4-c94d-40e1-ad4b-77d54e25a156 with Priority: HIGHEST for action security_group_rules [ 1257.848060] env[65337]: INFO networking_nsxv3.common.synchronization [req-6ace0168-1830-4ac3-a641-ba05a3736ef7 req-86abfe7b-3ed1-4778-a2d5-8448c577649b service nova] Enqueued Resource ID: c043a4b4-c94d-40e1-ad4b-77d54e25a156 with Priority: HIGHEST for action security_group_members [ 1257.848198] env[65337]: INFO networking_nsxv3.common.synchronization [req-6ace0168-1830-4ac3-a641-ba05a3736ef7 req-86abfe7b-3ed1-4778-a2d5-8448c577649b service nova] Enqueued Resource ID: be43121c-5ee9-4303-a5f8-74c977cbaddd with Priority: HIGHEST for action port [ 1257.848768] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c043a4b4-c94d-40e1-ad4b-77d54e25a156 with Priority: HIGHEST for action security_group_rules [ 1257.848877] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c043a4b4-c94d-40e1-ad4b-77d54e25a156 with Priority: HIGHEST for action security_group_members [ 1257.848877] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be43121c-5ee9-4303-a5f8-74c977cbaddd with Priority: HIGHEST for action port [ 1257.849159] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c043a4b4-c94d-40e1-ad4b-77d54e25a156 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.849331] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c043a4b4-c94d-40e1-ad4b-77d54e25a156" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.849331] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c043a4b4-c94d-40e1-ad4b-77d54e25a156" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.849578] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c043a4b4-c94d-40e1-ad4b-77d54e25a156" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.849578] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c043a4b4-c94d-40e1-ad4b-77d54e25a156',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.852116] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-c043a4b4-c94d-40e1-ad4b-77d54e25a156 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.852116] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c043a4b4-c94d-40e1-ad4b-77d54e25a156" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.852116] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c043a4b4-c94d-40e1-ad4b-77d54e25a156" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.852116] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c043a4b4-c94d-40e1-ad4b-77d54e25a156" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.852116] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.852116] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.852116] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.852116] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.852116] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.852116] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c043a4b4-c94d-40e1-ad4b-77d54e25a156',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.852116] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-be43121c-5ee9-4303-a5f8-74c977cbaddd taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.854329] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-be43121c-5ee9-4303-a5f8-74c977cbaddd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.854329] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-be43121c-5ee9-4303-a5f8-74c977cbaddd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.854329] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-be43121c-5ee9-4303-a5f8-74c977cbaddd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.854329] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('be43121c-5ee9-4303-a5f8-74c977cbaddd',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1258.122135] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.122367] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.122453] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.122676] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.122768] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.122864] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 303cb78d-3c85-4fcc-964c-f1082480bdd7 already deleted. [ 1258.122949] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-303cb78d-3c85-4fcc-964c-f1082480bdd7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.281703] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('65bdf164-5da2-4e67-8ed6-85fb2021a359',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1258.355114] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-c043a4b4-c94d-40e1-ad4b-77d54e25a156 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.355425] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c043a4b4-c94d-40e1-ad4b-77d54e25a156" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.355425] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c043a4b4-c94d-40e1-ad4b-77d54e25a156',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1258.356416] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port be43121c-5ee9-4303-a5f8-74c977cbaddd with status ACTIVE [ 1258.356722] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.356898] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.357075] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.357333] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.357471] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.358039] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.358039] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.358039] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.358306] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.358306] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.358598] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.358710] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.358853] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.359395] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.359395] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.359395] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: be43121c-5ee9-4303-a5f8-74c977cbaddd is going to be updated. [ 1258.384433] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.384757] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.384757] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.384942] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.384942] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.385081] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-be43121c-5ee9-4303-a5f8-74c977cbaddd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.784116] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('65bdf164-5da2-4e67-8ed6-85fb2021a359',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1258.862269] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c043a4b4-c94d-40e1-ad4b-77d54e25a156',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.287605] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.287823] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.287866] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.288221] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.288357] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.288487] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 65bdf164-5da2-4e67-8ed6-85fb2021a359 is going to be updated. [ 1259.319428] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.319636] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.319636] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.319893] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.320101] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.329601] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 65bdf164-5da2-4e67-8ed6-85fb2021a359 in Status: IN_PROGRESS for 2s [ 1259.364302] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.364812] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.364812] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.364895] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.365108] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.365108] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c043a4b4-c94d-40e1-ad4b-77d54e25a156 is going to be created. [ 1259.392016] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.392287] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.392287] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.392445] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.392601] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.409771] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c043a4b4-c94d-40e1-ad4b-77d54e25a156 in Status: UNINITIALIZED for 2s [ 1261.339277] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 65bdf164-5da2-4e67-8ed6-85fb2021a359 in Status: SUCCESS [ 1261.339732] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-65bdf164-5da2-4e67-8ed6-85fb2021a359" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.339732] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-65bdf164-5da2-4e67-8ed6-85fb2021a359" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.339940] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-65bdf164-5da2-4e67-8ed6-85fb2021a359" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.340146] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.340255] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.340319] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.340477] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.340576] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.340660] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-65bdf164-5da2-4e67-8ed6-85fb2021a359" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.340780] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('65bdf164-5da2-4e67-8ed6-85fb2021a359',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1261.419319] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c043a4b4-c94d-40e1-ad4b-77d54e25a156 in Status: SUCCESS [ 1261.419488] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c043a4b4-c94d-40e1-ad4b-77d54e25a156" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.419624] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c043a4b4-c94d-40e1-ad4b-77d54e25a156" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.419844] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c043a4b4-c94d-40e1-ad4b-77d54e25a156" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.420048] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.420166] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.420234] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.420380] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.420460] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.420545] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c043a4b4-c94d-40e1-ad4b-77d54e25a156" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.420635] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c043a4b4-c94d-40e1-ad4b-77d54e25a156',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1261.843041] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-65bdf164-5da2-4e67-8ed6-85fb2021a359 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.843041] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-65bdf164-5da2-4e67-8ed6-85fb2021a359" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.843226] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-65bdf164-5da2-4e67-8ed6-85fb2021a359" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.843334] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-65bdf164-5da2-4e67-8ed6-85fb2021a359" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.843501] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.843604] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.843669] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.843816] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.843900] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.843988] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-65bdf164-5da2-4e67-8ed6-85fb2021a359" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.844177] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-65bdf164-5da2-4e67-8ed6-85fb2021a359 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.844242] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-65bdf164-5da2-4e67-8ed6-85fb2021a359" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.844282] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-65bdf164-5da2-4e67-8ed6-85fb2021a359" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.844452] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-65bdf164-5da2-4e67-8ed6-85fb2021a359" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.844740] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.844859] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.844926] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.845123] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.845257] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.845359] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-65bdf164-5da2-4e67-8ed6-85fb2021a359" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.845453] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('65bdf164-5da2-4e67-8ed6-85fb2021a359',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1261.923117] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c043a4b4-c94d-40e1-ad4b-77d54e25a156',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1262.347372] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 65bdf164-5da2-4e67-8ed6-85fb2021a359: rpc.has_security_group_logging(os_id): False [ 1262.368935] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.369147] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.369147] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.369464] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.369646] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.369879] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.370049] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.370152] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.370434] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.370509] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.370816] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.370965] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.371076] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.371285] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.371408] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.371720] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.371880] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.371880] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.372062] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.372142] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.372203] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 65bdf164-5da2-4e67-8ed6-85fb2021a359 is going to be updated. [ 1262.425988] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c043a4b4-c94d-40e1-ad4b-77d54e25a156: rpc.has_security_group_logging(os_id): False [ 1262.439037] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.439267] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.439267] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.439495] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.439616] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.447016] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.447246] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.447329] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.447517] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.447625] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.447869] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.447992] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.448121] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.448300] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.448410] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.448484] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c043a4b4-c94d-40e1-ad4b-77d54e25a156 is going to be created. [ 1262.451945] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 65bdf164-5da2-4e67-8ed6-85fb2021a359 in Status: IN_PROGRESS for 2s [ 1262.520393] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.520628] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.520759] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.521083] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.521338] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.538810] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c043a4b4-c94d-40e1-ad4b-77d54e25a156 in Status: IN_PROGRESS for 2s [ 1262.850989] env[65337]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1262.850989] env[65337]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=3 [ 1264.468341] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 65bdf164-5da2-4e67-8ed6-85fb2021a359 in Status: SUCCESS [ 1264.468654] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-65bdf164-5da2-4e67-8ed6-85fb2021a359" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.468909] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-65bdf164-5da2-4e67-8ed6-85fb2021a359" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.469241] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-65bdf164-5da2-4e67-8ed6-85fb2021a359" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.469376] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('65bdf164-5da2-4e67-8ed6-85fb2021a359',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1264.554016] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c043a4b4-c94d-40e1-ad4b-77d54e25a156 in Status: SUCCESS [ 1264.554398] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c043a4b4-c94d-40e1-ad4b-77d54e25a156" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.868856] env[65337]: INFO networking_nsxv3.common.synchronization [req-a8ae2fc9-0d60-4591-8e80-fd04c32395ad req-288e7aba-a860-46b7-a7bc-b9b938f75f9f tempest-ServerRescueNegativeTestJSON-59296460 tempest-ServerRescueNegativeTestJSON-59296460-project-member] Enqueued Resource ID: 303cb78d-3c85-4fcc-964c-f1082480bdd7 with Priority: HIGHEST for action security_group_members [ 1264.869032] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 303cb78d-3c85-4fcc-964c-f1082480bdd7 with Priority: HIGHEST for action security_group_members [ 1264.869256] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-303cb78d-3c85-4fcc-964c-f1082480bdd7 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.869377] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-303cb78d-3c85-4fcc-964c-f1082480bdd7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.869444] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-303cb78d-3c85-4fcc-964c-f1082480bdd7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.869693] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-303cb78d-3c85-4fcc-964c-f1082480bdd7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.869856] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.869955] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.870071] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.870180] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.870378] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.870496] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('303cb78d-3c85-4fcc-964c-f1082480bdd7',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1264.972219] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-65bdf164-5da2-4e67-8ed6-85fb2021a359 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.972857] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-65bdf164-5da2-4e67-8ed6-85fb2021a359" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.973073] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-65bdf164-5da2-4e67-8ed6-85fb2021a359" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.973430] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-65bdf164-5da2-4e67-8ed6-85fb2021a359" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.973744] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.973986] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.974126] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.974372] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.974527] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.974685] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-65bdf164-5da2-4e67-8ed6-85fb2021a359" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.974838] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('65bdf164-5da2-4e67-8ed6-85fb2021a359',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1265.273341] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock network-960 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.273577] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "network-960" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.273698] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "network-960" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.273996] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "network-960" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.274963] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.275218] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.275376] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.275683] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.275856] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.276169] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1265.276365] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1265.276578] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1265.276698] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1265.276835] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1265.276954] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1265.277110] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1265.299130] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1265.299328] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1265.299390] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1265.299563] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "network-960" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.299960] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock port-4c071346-2721-48f6-bbc2-9e4616ef4637 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.300154] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "port-4c071346-2721-48f6-bbc2-9e4616ef4637" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.300277] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "port-4c071346-2721-48f6-bbc2-9e4616ef4637" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.300601] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "port-4c071346-2721-48f6-bbc2-9e4616ef4637" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.301145] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4c071346-2721-48f6-bbc2-9e4616ef4637',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1265.373088] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.373312] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.373424] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.373673] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.373775] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.373967] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.374099] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.374179] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.374344] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.374460] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.374547] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 303cb78d-3c85-4fcc-964c-f1082480bdd7 already deleted. [ 1265.374655] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-303cb78d-3c85-4fcc-964c-f1082480bdd7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.424760] env[65337]: INFO networking_nsxv3.common.synchronization [req-d02c6013-07a2-4ef9-9a0e-fcdf0e8c0ac5 req-7a6fba64-4d1e-4759-97ff-c7ec2aa9d8b6 tempest-ListServersNegativeTestJSON-458152726 tempest-ListServersNegativeTestJSON-458152726-project-member] Enqueued Resource ID: 65bdf164-5da2-4e67-8ed6-85fb2021a359 with Priority: HIGHEST for action security_group_members [ 1265.425503] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65bdf164-5da2-4e67-8ed6-85fb2021a359 with Priority: HIGHEST for action security_group_members [ 1265.425926] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-65bdf164-5da2-4e67-8ed6-85fb2021a359 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.426035] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-65bdf164-5da2-4e67-8ed6-85fb2021a359" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.426158] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-65bdf164-5da2-4e67-8ed6-85fb2021a359" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.426300] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-65bdf164-5da2-4e67-8ed6-85fb2021a359" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.426515] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.426648] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.426828] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.426928] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.426928] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.427120] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('65bdf164-5da2-4e67-8ed6-85fb2021a359',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1265.480414] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-65bdf164-5da2-4e67-8ed6-85fb2021a359 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.480414] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-65bdf164-5da2-4e67-8ed6-85fb2021a359" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.604170] env[65337]: INFO networking_nsxv3.common.synchronization [req-49a92e50-8c7e-40ab-b7c4-0400a980eff9 req-1643bc2e-7c07-4e1c-84d3-2ea66a663ba8 tempest-ListServersNegativeTestJSON-458152726 tempest-ListServersNegativeTestJSON-458152726-project-member] Enqueued Resource ID: 65bdf164-5da2-4e67-8ed6-85fb2021a359 with Priority: HIGHEST for action security_group_members [ 1265.604916] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65bdf164-5da2-4e67-8ed6-85fb2021a359 with Priority: HIGHEST for action security_group_members [ 1265.605490] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-65bdf164-5da2-4e67-8ed6-85fb2021a359 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.605669] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-65bdf164-5da2-4e67-8ed6-85fb2021a359" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.805032] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.805430] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.805563] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.805858] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.806077] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.806430] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Segment Port 4c071346-2721-48f6-bbc2-9e4616ef4637 not found, creating... [ 1265.806679] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.807834] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.807834] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.807834] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.807834] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.808868] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.808868] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.808868] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.808868] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.809111] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.809330] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Resource: SegmentPort with ID: 4c071346-2721-48f6-bbc2-9e4616ef4637 is going to be created. [ 1265.834732] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.834732] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.834732] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.834732] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.835098] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.835200] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "port-4c071346-2721-48f6-bbc2-9e4616ef4637" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.929422] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('65bdf164-5da2-4e67-8ed6-85fb2021a359',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.431422] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('65bdf164-5da2-4e67-8ed6-85fb2021a359',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.528596] env[65337]: INFO networking_nsxv3.common.synchronization [req-a8ae2fc9-0d60-4591-8e80-fd04c32395ad req-2d9756ae-47a1-4619-84d0-b53dc3c0793d service nova] Enqueued Resource ID: 303cb78d-3c85-4fcc-964c-f1082480bdd7 with Priority: HIGHEST for action security_group_rules [ 1266.528883] env[65337]: INFO networking_nsxv3.common.synchronization [req-a8ae2fc9-0d60-4591-8e80-fd04c32395ad req-2d9756ae-47a1-4619-84d0-b53dc3c0793d service nova] Enqueued Resource ID: 303cb78d-3c85-4fcc-964c-f1082480bdd7 with Priority: HIGHEST for action security_group_members [ 1266.528940] env[65337]: INFO networking_nsxv3.common.synchronization [req-a8ae2fc9-0d60-4591-8e80-fd04c32395ad req-2d9756ae-47a1-4619-84d0-b53dc3c0793d service nova] Enqueued Resource ID: 4c071346-2721-48f6-bbc2-9e4616ef4637 with Priority: HIGHEST for action port [ 1266.530226] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 303cb78d-3c85-4fcc-964c-f1082480bdd7 with Priority: HIGHEST for action security_group_rules [ 1266.530226] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 303cb78d-3c85-4fcc-964c-f1082480bdd7 with Priority: HIGHEST for action security_group_members [ 1266.530226] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c071346-2721-48f6-bbc2-9e4616ef4637 with Priority: HIGHEST for action port [ 1266.530226] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-303cb78d-3c85-4fcc-964c-f1082480bdd7 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.530226] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-303cb78d-3c85-4fcc-964c-f1082480bdd7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.530226] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-303cb78d-3c85-4fcc-964c-f1082480bdd7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.530529] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-303cb78d-3c85-4fcc-964c-f1082480bdd7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.530618] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('303cb78d-3c85-4fcc-964c-f1082480bdd7',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.531505] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-303cb78d-3c85-4fcc-964c-f1082480bdd7 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.532518] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-303cb78d-3c85-4fcc-964c-f1082480bdd7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.532518] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-303cb78d-3c85-4fcc-964c-f1082480bdd7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.532518] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-303cb78d-3c85-4fcc-964c-f1082480bdd7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.532518] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.532518] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.532518] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.532518] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.532518] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.532518] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('303cb78d-3c85-4fcc-964c-f1082480bdd7',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.533933] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-4c071346-2721-48f6-bbc2-9e4616ef4637 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.533933] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4c071346-2721-48f6-bbc2-9e4616ef4637" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.533933] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4c071346-2721-48f6-bbc2-9e4616ef4637" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.533933] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4c071346-2721-48f6-bbc2-9e4616ef4637" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.534139] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4c071346-2721-48f6-bbc2-9e4616ef4637',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.934617] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.934860] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.934860] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.935130] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.935230] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.935332] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 65bdf164-5da2-4e67-8ed6-85fb2021a359 is going to be updated. [ 1266.965189] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.965382] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.965423] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.965629] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.965779] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.980594] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 65bdf164-5da2-4e67-8ed6-85fb2021a359 in Status: IN_PROGRESS for 2s [ 1267.036570] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-303cb78d-3c85-4fcc-964c-f1082480bdd7 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.036570] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-303cb78d-3c85-4fcc-964c-f1082480bdd7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.037405] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('303cb78d-3c85-4fcc-964c-f1082480bdd7',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1267.037942] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4c071346-2721-48f6-bbc2-9e4616ef4637 with status ACTIVE [ 1267.038160] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.038347] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.038347] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.038592] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.038674] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.038864] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.038996] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.039102] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.039274] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.039376] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.039843] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.039843] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.039843] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.040112] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.040220] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.040289] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4c071346-2721-48f6-bbc2-9e4616ef4637 is going to be updated. [ 1267.074393] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.074674] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.074733] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.074956] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.075155] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.075323] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4c071346-2721-48f6-bbc2-9e4616ef4637" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.542549] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('303cb78d-3c85-4fcc-964c-f1082480bdd7',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.045757] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.045940] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.045986] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.046231] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.046388] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.046452] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 303cb78d-3c85-4fcc-964c-f1082480bdd7 is going to be created. [ 1268.073514] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.073671] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.073740] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.073950] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.074389] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.085170] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 303cb78d-3c85-4fcc-964c-f1082480bdd7 in Status: UNINITIALIZED for 2s [ 1268.991908] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 65bdf164-5da2-4e67-8ed6-85fb2021a359 in Status: SUCCESS [ 1268.992382] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-65bdf164-5da2-4e67-8ed6-85fb2021a359" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.992554] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-65bdf164-5da2-4e67-8ed6-85fb2021a359" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.992777] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-65bdf164-5da2-4e67-8ed6-85fb2021a359" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.992982] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.993165] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.993237] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.993435] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.993499] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.993552] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-65bdf164-5da2-4e67-8ed6-85fb2021a359" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.993745] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-65bdf164-5da2-4e67-8ed6-85fb2021a359 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.993839] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-65bdf164-5da2-4e67-8ed6-85fb2021a359" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.993898] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-65bdf164-5da2-4e67-8ed6-85fb2021a359" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.994486] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-65bdf164-5da2-4e67-8ed6-85fb2021a359" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.994486] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.994486] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.994486] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.994486] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.994744] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.994744] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-65bdf164-5da2-4e67-8ed6-85fb2021a359" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.994744] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('65bdf164-5da2-4e67-8ed6-85fb2021a359',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.995867] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-65bdf164-5da2-4e67-8ed6-85fb2021a359" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.995989] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-65bdf164-5da2-4e67-8ed6-85fb2021a359" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.996087] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.996722] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.996722] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.996722] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.996722] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.996722] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('65bdf164-5da2-4e67-8ed6-85fb2021a359',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.498391] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 65bdf164-5da2-4e67-8ed6-85fb2021a359: rpc.has_security_group_logging(os_id): False [ 1269.499751] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.499957] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.500053] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.500295] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.500421] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.500643] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.500785] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.500875] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.501092] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.501212] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.501326] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 65bdf164-5da2-4e67-8ed6-85fb2021a359 is going to be updated. [ 1269.518773] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.519013] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.519013] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.519227] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.519316] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.519508] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.519606] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.519807] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.519930] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.519998] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.520219] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.520316] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.520377] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.520516] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.520588] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.520776] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.520870] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.520917] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.521066] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.521139] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.521219] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 65bdf164-5da2-4e67-8ed6-85fb2021a359 is going to be updated. [ 1269.531231] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.531452] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.531452] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.531635] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.531881] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.540092] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 65bdf164-5da2-4e67-8ed6-85fb2021a359 in Status: IN_PROGRESS for 2s [ 1269.583595] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.583785] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.583785] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.584036] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.584187] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.600545] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 65bdf164-5da2-4e67-8ed6-85fb2021a359 in Status: IN_PROGRESS for 2s [ 1270.101956] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 303cb78d-3c85-4fcc-964c-f1082480bdd7 in Status: SUCCESS [ 1270.102236] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-303cb78d-3c85-4fcc-964c-f1082480bdd7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.102432] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-303cb78d-3c85-4fcc-964c-f1082480bdd7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.102679] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-303cb78d-3c85-4fcc-964c-f1082480bdd7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.102924] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.103079] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.103164] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.103352] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.103453] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.103558] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-303cb78d-3c85-4fcc-964c-f1082480bdd7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.103744] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('303cb78d-3c85-4fcc-964c-f1082480bdd7',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.606062] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('303cb78d-3c85-4fcc-964c-f1082480bdd7',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.108036] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 303cb78d-3c85-4fcc-964c-f1082480bdd7: rpc.has_security_group_logging(os_id): False [ 1271.130145] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.130380] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.130380] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.130652] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.130759] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.131034] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.131165] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.131230] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.131420] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.131506] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.131676] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 303cb78d-3c85-4fcc-964c-f1082480bdd7 is going to be created. [ 1271.193149] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.193351] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.193351] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.193509] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.193693] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.205921] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 303cb78d-3c85-4fcc-964c-f1082480bdd7 in Status: IN_PROGRESS for 2s [ 1271.534266] env[65337]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1271.534372] env[65337]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=3 [ 1271.550020] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 65bdf164-5da2-4e67-8ed6-85fb2021a359 in Status: SUCCESS [ 1271.550230] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 65bdf164-5da2-4e67-8ed6-85fb2021a359 deletion is rescheduled due to dependency. [ 1271.550344] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-65bdf164-5da2-4e67-8ed6-85fb2021a359" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.615634] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 65bdf164-5da2-4e67-8ed6-85fb2021a359 in Status: SUCCESS [ 1271.615838] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-65bdf164-5da2-4e67-8ed6-85fb2021a359" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.218791] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 303cb78d-3c85-4fcc-964c-f1082480bdd7 in Status: SUCCESS [ 1273.219182] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-303cb78d-3c85-4fcc-964c-f1082480bdd7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.985636] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock network-981 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.985844] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "network-981" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.985970] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "network-981" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.986327] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "network-981" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.986604] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.986789] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.986911] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.987273] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.987460] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.987702] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1273.987856] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1273.987990] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1273.988139] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1273.988290] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1273.988423] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1273.988582] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1274.012625] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1274.012919] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1274.013190] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1274.013451] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "network-981" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.013847] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock port-8e3fb8a8-6dc5-4513-afec-07866c295ec8 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.014157] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "port-8e3fb8a8-6dc5-4513-afec-07866c295ec8" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.014389] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "port-8e3fb8a8-6dc5-4513-afec-07866c295ec8" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.014764] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "port-8e3fb8a8-6dc5-4513-afec-07866c295ec8" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.014982] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8e3fb8a8-6dc5-4513-afec-07866c295ec8',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.517757] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.518212] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.518212] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.518399] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.518554] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.518907] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.519137] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.519281] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.519536] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.519701] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.520012] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.520338] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.520532] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.520778] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.520947] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.521170] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Resource: SegmentPort with ID: 8e3fb8a8-6dc5-4513-afec-07866c295ec8 is going to be updated. [ 1274.546288] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.546506] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.546645] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.546986] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.547235] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.547605] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "port-8e3fb8a8-6dc5-4513-afec-07866c295ec8" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.260326] env[65337]: INFO networking_nsxv3.common.synchronization [None req-b5e2619b-61ea-4973-8e36-ff63830e3ff5 None None] Enqueued Resource ID: f181e485-26a9-4062-83f0-a844c6d92d4a with Priority: HIGHEST for action port [ 1275.260326] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f181e485-26a9-4062-83f0-a844c6d92d4a with Priority: HIGHEST for action port [ 1275.260326] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-f181e485-26a9-4062-83f0-a844c6d92d4a taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.260326] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f181e485-26a9-4062-83f0-a844c6d92d4a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.260326] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f181e485-26a9-4062-83f0-a844c6d92d4a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.260326] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f181e485-26a9-4062-83f0-a844c6d92d4a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.260326] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f181e485-26a9-4062-83f0-a844c6d92d4a',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1275.266241] env[65337]: INFO networking_nsxv3.common.synchronization [req-6f3dd2f5-4af6-4936-bc23-403aa65ee8e5 req-727a21c8-a604-44f2-863c-f3a972834331 service nova] Enqueued Resource ID: a64509fd-193d-41f5-8257-21afcd1d96a2 with Priority: HIGHEST for action security_group_rules [ 1275.266241] env[65337]: INFO networking_nsxv3.common.synchronization [req-6f3dd2f5-4af6-4936-bc23-403aa65ee8e5 req-727a21c8-a604-44f2-863c-f3a972834331 service nova] Enqueued Resource ID: a64509fd-193d-41f5-8257-21afcd1d96a2 with Priority: HIGHEST for action security_group_members [ 1275.266241] env[65337]: INFO networking_nsxv3.common.synchronization [req-6f3dd2f5-4af6-4936-bc23-403aa65ee8e5 req-727a21c8-a604-44f2-863c-f3a972834331 service nova] Enqueued Resource ID: 8e3fb8a8-6dc5-4513-afec-07866c295ec8 with Priority: HIGHEST for action port [ 1275.266241] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a64509fd-193d-41f5-8257-21afcd1d96a2 with Priority: HIGHEST for action security_group_rules [ 1275.266241] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a64509fd-193d-41f5-8257-21afcd1d96a2 with Priority: HIGHEST for action security_group_members [ 1275.266241] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e3fb8a8-6dc5-4513-afec-07866c295ec8 with Priority: HIGHEST for action port [ 1275.266241] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a64509fd-193d-41f5-8257-21afcd1d96a2 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.266241] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a64509fd-193d-41f5-8257-21afcd1d96a2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.266241] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a64509fd-193d-41f5-8257-21afcd1d96a2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.266241] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a64509fd-193d-41f5-8257-21afcd1d96a2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.266241] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a64509fd-193d-41f5-8257-21afcd1d96a2',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1275.267976] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-a64509fd-193d-41f5-8257-21afcd1d96a2 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.268250] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a64509fd-193d-41f5-8257-21afcd1d96a2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.269224] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a64509fd-193d-41f5-8257-21afcd1d96a2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.269224] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a64509fd-193d-41f5-8257-21afcd1d96a2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.269224] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.269224] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.269224] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.269224] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.269224] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.269906] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a64509fd-193d-41f5-8257-21afcd1d96a2',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1275.271758] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-8e3fb8a8-6dc5-4513-afec-07866c295ec8 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.271758] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8e3fb8a8-6dc5-4513-afec-07866c295ec8" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.271758] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8e3fb8a8-6dc5-4513-afec-07866c295ec8" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.271758] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8e3fb8a8-6dc5-4513-afec-07866c295ec8" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.271758] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8e3fb8a8-6dc5-4513-afec-07866c295ec8',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1275.764117] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f181e485-26a9-4062-83f0-a844c6d92d4a [ 1275.764957] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.764957] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.764957] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.764957] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.764957] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.764957] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f181e485-26a9-4062-83f0-a844c6d92d4a already deleted. [ 1275.765235] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f181e485-26a9-4062-83f0-a844c6d92d4a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.768653] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-a64509fd-193d-41f5-8257-21afcd1d96a2 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.768731] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a64509fd-193d-41f5-8257-21afcd1d96a2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.773290] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a64509fd-193d-41f5-8257-21afcd1d96a2',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1275.775942] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8e3fb8a8-6dc5-4513-afec-07866c295ec8 with status ACTIVE [ 1275.776136] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.776251] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.777167] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.777167] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.777167] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.777167] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.777167] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.777167] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.777167] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.777167] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.777539] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.777539] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.777539] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.777644] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.777690] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.777784] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8e3fb8a8-6dc5-4513-afec-07866c295ec8 is going to be updated. [ 1275.799036] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.799258] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.799258] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.799405] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.799542] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.799703] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8e3fb8a8-6dc5-4513-afec-07866c295ec8" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.275610] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a64509fd-193d-41f5-8257-21afcd1d96a2',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.778620] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.779062] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.779062] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.779184] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.779286] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.779388] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a64509fd-193d-41f5-8257-21afcd1d96a2 is going to be updated. [ 1276.811035] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.811178] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.811253] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.811468] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.811614] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.822990] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a64509fd-193d-41f5-8257-21afcd1d96a2 in Status: IN_PROGRESS for 2s [ 1277.416780] env[65337]: INFO networking_nsxv3.common.synchronization [None req-eca19ada-d5f9-4855-9722-0c16bf1404f9 None None] Enqueued Resource ID: fdce0a11-a2da-411b-9566-8e45e5792531 with Priority: HIGHEST for action port [ 1277.417349] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fdce0a11-a2da-411b-9566-8e45e5792531 with Priority: HIGHEST for action port [ 1277.417660] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-fdce0a11-a2da-411b-9566-8e45e5792531 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.417805] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fdce0a11-a2da-411b-9566-8e45e5792531" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.417874] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fdce0a11-a2da-411b-9566-8e45e5792531" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.418779] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fdce0a11-a2da-411b-9566-8e45e5792531" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.418890] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fdce0a11-a2da-411b-9566-8e45e5792531',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1277.921008] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fdce0a11-a2da-411b-9566-8e45e5792531 [ 1277.921300] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.921419] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.921479] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.921692] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.921785] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.921877] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fdce0a11-a2da-411b-9566-8e45e5792531 already deleted. [ 1277.921958] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fdce0a11-a2da-411b-9566-8e45e5792531" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.834591] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a64509fd-193d-41f5-8257-21afcd1d96a2 in Status: SUCCESS [ 1278.834807] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a64509fd-193d-41f5-8257-21afcd1d96a2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.834980] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a64509fd-193d-41f5-8257-21afcd1d96a2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.835216] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a64509fd-193d-41f5-8257-21afcd1d96a2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.835395] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.835510] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.835575] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.836500] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.836500] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.836500] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a64509fd-193d-41f5-8257-21afcd1d96a2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.836500] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a64509fd-193d-41f5-8257-21afcd1d96a2',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1279.338253] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a64509fd-193d-41f5-8257-21afcd1d96a2',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1279.839938] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a64509fd-193d-41f5-8257-21afcd1d96a2: rpc.has_security_group_logging(os_id): False [ 1279.859101] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.859360] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.859360] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.859611] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.859745] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.860107] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.860243] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.860301] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.860472] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.860561] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.860668] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a64509fd-193d-41f5-8257-21afcd1d96a2 is going to be updated. [ 1279.927926] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.928162] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.928162] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.928395] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.928541] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.941360] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a64509fd-193d-41f5-8257-21afcd1d96a2 in Status: IN_PROGRESS for 2s [ 1280.642051] env[65337]: INFO networking_nsxv3.common.synchronization [req-7348e814-b915-46e7-935f-fcbb5ec6cda8 req-f8482e3d-51d6-494f-acb5-53949526e457 tempest-ServerRescueTestJSONUnderV235-503777086 tempest-ServerRescueTestJSONUnderV235-503777086-project-member] Enqueued Resource ID: 674737c3-16d2-48fa-90a6-8e057d80dc3a with Priority: HIGHEST for action security_group_members [ 1280.642647] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 674737c3-16d2-48fa-90a6-8e057d80dc3a with Priority: HIGHEST for action security_group_members [ 1280.642963] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-674737c3-16d2-48fa-90a6-8e057d80dc3a taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.643102] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-674737c3-16d2-48fa-90a6-8e057d80dc3a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.643164] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-674737c3-16d2-48fa-90a6-8e057d80dc3a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.643408] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-674737c3-16d2-48fa-90a6-8e057d80dc3a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.643566] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.643663] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.643724] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.643869] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.643952] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.644058] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('674737c3-16d2-48fa-90a6-8e057d80dc3a',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.987321] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock network-885 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.987560] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "network-885" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.987650] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "network-885" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.988046] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "network-885" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.988336] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.988498] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.988620] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.988921] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.989232] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.989486] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1280.989607] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1280.989719] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1280.989832] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1280.989945] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1280.990069] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1280.990209] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1281.017290] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1281.017498] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1281.017597] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1281.017808] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "network-885" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.018179] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock port-799014ab-6c8d-4784-b418-398847ad0f81 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.018364] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "port-799014ab-6c8d-4784-b418-398847ad0f81" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.018506] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "port-799014ab-6c8d-4784-b418-398847ad0f81" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.018928] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "port-799014ab-6c8d-4784-b418-398847ad0f81" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.019095] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('799014ab-6c8d-4784-b418-398847ad0f81',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.146551] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.146820] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.146820] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.147040] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.147138] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.147339] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.147449] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.147497] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.147659] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.147751] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.147845] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 674737c3-16d2-48fa-90a6-8e057d80dc3a already deleted. [ 1281.147955] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-674737c3-16d2-48fa-90a6-8e057d80dc3a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.521428] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.521643] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.521913] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.522197] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.522512] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.522675] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Segment Port 799014ab-6c8d-4784-b418-398847ad0f81 not found, creating... [ 1281.523141] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.523457] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.523643] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.524034] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.524276] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.524793] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.524979] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.525116] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.525352] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.525490] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.525646] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Resource: SegmentPort with ID: 799014ab-6c8d-4784-b418-398847ad0f81 is going to be created. [ 1281.554282] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.554597] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.554670] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.555115] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.555433] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.555689] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "port-799014ab-6c8d-4784-b418-398847ad0f81" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.955984] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a64509fd-193d-41f5-8257-21afcd1d96a2 in Status: SUCCESS [ 1281.956399] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a64509fd-193d-41f5-8257-21afcd1d96a2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.277613] env[65337]: INFO networking_nsxv3.common.synchronization [req-7348e814-b915-46e7-935f-fcbb5ec6cda8 req-2237dbe1-3380-484a-b7a4-f3e8f0b3cdef service nova] Enqueued Resource ID: 674737c3-16d2-48fa-90a6-8e057d80dc3a with Priority: HIGHEST for action security_group_rules [ 1282.277785] env[65337]: INFO networking_nsxv3.common.synchronization [req-7348e814-b915-46e7-935f-fcbb5ec6cda8 req-2237dbe1-3380-484a-b7a4-f3e8f0b3cdef service nova] Enqueued Resource ID: 674737c3-16d2-48fa-90a6-8e057d80dc3a with Priority: HIGHEST for action security_group_members [ 1282.277923] env[65337]: INFO networking_nsxv3.common.synchronization [req-7348e814-b915-46e7-935f-fcbb5ec6cda8 req-2237dbe1-3380-484a-b7a4-f3e8f0b3cdef service nova] Enqueued Resource ID: 799014ab-6c8d-4784-b418-398847ad0f81 with Priority: HIGHEST for action port [ 1282.279025] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 674737c3-16d2-48fa-90a6-8e057d80dc3a with Priority: HIGHEST for action security_group_rules [ 1282.279025] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 674737c3-16d2-48fa-90a6-8e057d80dc3a with Priority: HIGHEST for action security_group_members [ 1282.279025] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 799014ab-6c8d-4784-b418-398847ad0f81 with Priority: HIGHEST for action port [ 1282.279025] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-674737c3-16d2-48fa-90a6-8e057d80dc3a taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.279322] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-674737c3-16d2-48fa-90a6-8e057d80dc3a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.279384] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-674737c3-16d2-48fa-90a6-8e057d80dc3a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.279652] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-674737c3-16d2-48fa-90a6-8e057d80dc3a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.280058] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('674737c3-16d2-48fa-90a6-8e057d80dc3a',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1282.281096] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-674737c3-16d2-48fa-90a6-8e057d80dc3a taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.281258] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-674737c3-16d2-48fa-90a6-8e057d80dc3a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.281335] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-674737c3-16d2-48fa-90a6-8e057d80dc3a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.281523] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-674737c3-16d2-48fa-90a6-8e057d80dc3a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.283027] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.283027] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.283027] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.283027] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.283027] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.283027] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('674737c3-16d2-48fa-90a6-8e057d80dc3a',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1282.283674] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-799014ab-6c8d-4784-b418-398847ad0f81 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.283842] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-799014ab-6c8d-4784-b418-398847ad0f81" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.283945] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-799014ab-6c8d-4784-b418-398847ad0f81" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.284552] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-799014ab-6c8d-4784-b418-398847ad0f81" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.284552] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('799014ab-6c8d-4784-b418-398847ad0f81',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1282.782419] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-674737c3-16d2-48fa-90a6-8e057d80dc3a taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.782556] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-674737c3-16d2-48fa-90a6-8e057d80dc3a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.787994] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 799014ab-6c8d-4784-b418-398847ad0f81 with status ACTIVE [ 1282.787994] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.787994] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.787994] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.787994] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.787994] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.788255] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.788354] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.788354] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.788557] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.788672] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.788875] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.789107] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.789107] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.789335] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.789335] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.789891] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 799014ab-6c8d-4784-b418-398847ad0f81 is going to be updated. [ 1282.791339] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('674737c3-16d2-48fa-90a6-8e057d80dc3a',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1282.814457] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.814625] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.814688] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.814891] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.815053] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.815222] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-799014ab-6c8d-4784-b418-398847ad0f81" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.295232] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('674737c3-16d2-48fa-90a6-8e057d80dc3a',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1283.798261] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.798473] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.798473] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.798695] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.798805] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.798908] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 674737c3-16d2-48fa-90a6-8e057d80dc3a is going to be created. [ 1283.821650] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.821650] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.821938] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.821938] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.822161] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.833843] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 674737c3-16d2-48fa-90a6-8e057d80dc3a in Status: UNINITIALIZED for 2s [ 1285.845178] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 674737c3-16d2-48fa-90a6-8e057d80dc3a in Status: SUCCESS [ 1285.845559] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-674737c3-16d2-48fa-90a6-8e057d80dc3a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.845559] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-674737c3-16d2-48fa-90a6-8e057d80dc3a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.845786] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-674737c3-16d2-48fa-90a6-8e057d80dc3a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.846050] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.846176] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.846250] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.846390] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.846470] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.846581] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-674737c3-16d2-48fa-90a6-8e057d80dc3a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.846723] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('674737c3-16d2-48fa-90a6-8e057d80dc3a',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1286.349530] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-674737c3-16d2-48fa-90a6-8e057d80dc3a taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.349760] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-674737c3-16d2-48fa-90a6-8e057d80dc3a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.349760] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-674737c3-16d2-48fa-90a6-8e057d80dc3a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.349972] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-674737c3-16d2-48fa-90a6-8e057d80dc3a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.350168] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.350266] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.350328] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.350476] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.350561] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.350648] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-674737c3-16d2-48fa-90a6-8e057d80dc3a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.350790] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-674737c3-16d2-48fa-90a6-8e057d80dc3a taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.350885] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-674737c3-16d2-48fa-90a6-8e057d80dc3a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.350946] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-674737c3-16d2-48fa-90a6-8e057d80dc3a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.351104] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-674737c3-16d2-48fa-90a6-8e057d80dc3a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.351237] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.351325] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.351383] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.351516] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.351588] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.351667] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-674737c3-16d2-48fa-90a6-8e057d80dc3a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.351758] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('674737c3-16d2-48fa-90a6-8e057d80dc3a',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1286.854532] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 674737c3-16d2-48fa-90a6-8e057d80dc3a: rpc.has_security_group_logging(os_id): False [ 1286.873071] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.873261] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.873333] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.873501] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.873592] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.873782] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.873880] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.873943] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.874115] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.874194] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.874380] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.874476] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.874536] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.874707] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.874787] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.874972] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.875079] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.875139] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.875276] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.875347] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.875429] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 674737c3-16d2-48fa-90a6-8e057d80dc3a is going to be created. [ 1286.927205] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.927396] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.927396] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.927939] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.927939] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.939923] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 674737c3-16d2-48fa-90a6-8e057d80dc3a in Status: IN_PROGRESS for 2s [ 1287.279849] env[65337]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1287.279992] env[65337]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1288.952883] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 674737c3-16d2-48fa-90a6-8e057d80dc3a in Status: SUCCESS [ 1288.953291] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-674737c3-16d2-48fa-90a6-8e057d80dc3a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.280824] env[65337]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1292.281219] env[65337]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1297.282338] env[65337]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1297.282338] env[65337]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1298.566991] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.567346] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.567346] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.567515] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.567629] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1299.070762] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1299.572765] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.075467] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1300.075682] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1300.315184] env[65337]: INFO networking_nsxv3.common.synchronization [req-97644a8b-29b5-4f44-8f56-b7b9a6981609 req-6ce46c61-4370-4607-9fad-dfb5a3a992fd tempest-ServerRescueTestJSONUnderV235-503777086 tempest-ServerRescueTestJSONUnderV235-503777086-project-member] Enqueued Resource ID: fd20e012-263e-477c-91bd-a979e5418371 with Priority: HIGHEST for action security_group_members [ 1300.315265] env[65337]: INFO networking_nsxv3.common.synchronization [req-97644a8b-29b5-4f44-8f56-b7b9a6981609 req-6ce46c61-4370-4607-9fad-dfb5a3a992fd tempest-ServerRescueTestJSONUnderV235-503777086 tempest-ServerRescueTestJSONUnderV235-503777086-project-member] Enqueued Resource ID: 674737c3-16d2-48fa-90a6-8e057d80dc3a with Priority: HIGHEST for action security_group_members [ 1300.315826] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd20e012-263e-477c-91bd-a979e5418371 with Priority: HIGHEST for action security_group_members [ 1300.315989] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 674737c3-16d2-48fa-90a6-8e057d80dc3a with Priority: HIGHEST for action security_group_members [ 1300.316332] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd20e012-263e-477c-91bd-a979e5418371 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.316454] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd20e012-263e-477c-91bd-a979e5418371" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.316522] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd20e012-263e-477c-91bd-a979e5418371" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.316879] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd20e012-263e-477c-91bd-a979e5418371" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.317200] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.317200] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.317353] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.317523] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.317523] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.317634] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd20e012-263e-477c-91bd-a979e5418371',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.318531] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-674737c3-16d2-48fa-90a6-8e057d80dc3a taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.318681] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-674737c3-16d2-48fa-90a6-8e057d80dc3a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.318780] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-674737c3-16d2-48fa-90a6-8e057d80dc3a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.318970] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-674737c3-16d2-48fa-90a6-8e057d80dc3a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.319195] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.319341] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.319435] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.319628] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.319745] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.319877] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('674737c3-16d2-48fa-90a6-8e057d80dc3a',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.361032] env[65337]: INFO networking_nsxv3.common.synchronization [req-97644a8b-29b5-4f44-8f56-b7b9a6981609 req-6ce46c61-4370-4607-9fad-dfb5a3a992fd tempest-ServerRescueTestJSONUnderV235-503777086 tempest-ServerRescueTestJSONUnderV235-503777086-project-member] Enqueued Resource ID: 674737c3-16d2-48fa-90a6-8e057d80dc3a with Priority: HIGHEST for action security_group_rules [ 1300.361032] env[65337]: INFO networking_nsxv3.common.synchronization [req-97644a8b-29b5-4f44-8f56-b7b9a6981609 req-6ce46c61-4370-4607-9fad-dfb5a3a992fd tempest-ServerRescueTestJSONUnderV235-503777086 tempest-ServerRescueTestJSONUnderV235-503777086-project-member] Enqueued Resource ID: 674737c3-16d2-48fa-90a6-8e057d80dc3a with Priority: HIGHEST for action security_group_members [ 1300.361032] env[65337]: INFO networking_nsxv3.common.synchronization [req-97644a8b-29b5-4f44-8f56-b7b9a6981609 req-6ce46c61-4370-4607-9fad-dfb5a3a992fd tempest-ServerRescueTestJSONUnderV235-503777086 tempest-ServerRescueTestJSONUnderV235-503777086-project-member] Enqueued Resource ID: fd20e012-263e-477c-91bd-a979e5418371 with Priority: HIGHEST for action security_group_rules [ 1300.361032] env[65337]: INFO networking_nsxv3.common.synchronization [req-97644a8b-29b5-4f44-8f56-b7b9a6981609 req-6ce46c61-4370-4607-9fad-dfb5a3a992fd tempest-ServerRescueTestJSONUnderV235-503777086 tempest-ServerRescueTestJSONUnderV235-503777086-project-member] Enqueued Resource ID: fd20e012-263e-477c-91bd-a979e5418371 with Priority: HIGHEST for action security_group_members [ 1300.361032] env[65337]: INFO networking_nsxv3.common.synchronization [req-97644a8b-29b5-4f44-8f56-b7b9a6981609 req-6ce46c61-4370-4607-9fad-dfb5a3a992fd tempest-ServerRescueTestJSONUnderV235-503777086 tempest-ServerRescueTestJSONUnderV235-503777086-project-member] Enqueued Resource ID: 799014ab-6c8d-4784-b418-398847ad0f81 with Priority: HIGHEST for action port [ 1300.361032] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 674737c3-16d2-48fa-90a6-8e057d80dc3a with Priority: HIGHEST for action security_group_rules [ 1300.361032] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd20e012-263e-477c-91bd-a979e5418371 with Priority: HIGHEST for action security_group_rules [ 1300.361616] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 799014ab-6c8d-4784-b418-398847ad0f81 with Priority: HIGHEST for action port [ 1300.361835] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 674737c3-16d2-48fa-90a6-8e057d80dc3a with Priority: HIGHEST for action security_group_members [ 1300.362050] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd20e012-263e-477c-91bd-a979e5418371 with Priority: HIGHEST for action security_group_members [ 1300.362438] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-674737c3-16d2-48fa-90a6-8e057d80dc3a taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.362694] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-674737c3-16d2-48fa-90a6-8e057d80dc3a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.362857] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-674737c3-16d2-48fa-90a6-8e057d80dc3a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.363149] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-674737c3-16d2-48fa-90a6-8e057d80dc3a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.363329] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('674737c3-16d2-48fa-90a6-8e057d80dc3a',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.364248] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fd20e012-263e-477c-91bd-a979e5418371 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.364521] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fd20e012-263e-477c-91bd-a979e5418371" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.366021] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fd20e012-263e-477c-91bd-a979e5418371" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.366021] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fd20e012-263e-477c-91bd-a979e5418371" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.366021] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fd20e012-263e-477c-91bd-a979e5418371',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.366021] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-799014ab-6c8d-4784-b418-398847ad0f81 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.366379] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-799014ab-6c8d-4784-b418-398847ad0f81" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.366533] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-799014ab-6c8d-4784-b418-398847ad0f81" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.366789] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-799014ab-6c8d-4784-b418-398847ad0f81" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.366983] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('799014ab-6c8d-4784-b418-398847ad0f81',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.367775] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-674737c3-16d2-48fa-90a6-8e057d80dc3a taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.367986] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-674737c3-16d2-48fa-90a6-8e057d80dc3a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.368288] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd20e012-263e-477c-91bd-a979e5418371 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.368487] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd20e012-263e-477c-91bd-a979e5418371" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.660166] env[65337]: INFO networking_nsxv3.common.synchronization [req-709b3fc8-7963-4ccd-b2f2-92e10f0deb2f req-bef261b3-e8df-4931-97b1-55c75abf4cb4 tempest-ServerRescueTestJSONUnderV235-503777086 tempest-ServerRescueTestJSONUnderV235-503777086-project-member] Enqueued Resource ID: fd20e012-263e-477c-91bd-a979e5418371 with Priority: HIGHEST for action security_group_members [ 1300.660166] env[65337]: INFO networking_nsxv3.common.synchronization [req-709b3fc8-7963-4ccd-b2f2-92e10f0deb2f req-bef261b3-e8df-4931-97b1-55c75abf4cb4 tempest-ServerRescueTestJSONUnderV235-503777086 tempest-ServerRescueTestJSONUnderV235-503777086-project-member] Enqueued Resource ID: 674737c3-16d2-48fa-90a6-8e057d80dc3a with Priority: HIGHEST for action security_group_members [ 1300.660166] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd20e012-263e-477c-91bd-a979e5418371 with Priority: HIGHEST for action security_group_members [ 1300.660166] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 674737c3-16d2-48fa-90a6-8e057d80dc3a with Priority: HIGHEST for action security_group_members [ 1300.660582] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd20e012-263e-477c-91bd-a979e5418371 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.660582] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd20e012-263e-477c-91bd-a979e5418371" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.660676] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-674737c3-16d2-48fa-90a6-8e057d80dc3a taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.660728] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-674737c3-16d2-48fa-90a6-8e057d80dc3a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.708720] env[65337]: INFO networking_nsxv3.common.synchronization [req-709b3fc8-7963-4ccd-b2f2-92e10f0deb2f req-bef261b3-e8df-4931-97b1-55c75abf4cb4 tempest-ServerRescueTestJSONUnderV235-503777086 tempest-ServerRescueTestJSONUnderV235-503777086-project-member] Enqueued Resource ID: 674737c3-16d2-48fa-90a6-8e057d80dc3a with Priority: HIGHEST for action security_group_rules [ 1300.708902] env[65337]: INFO networking_nsxv3.common.synchronization [req-709b3fc8-7963-4ccd-b2f2-92e10f0deb2f req-bef261b3-e8df-4931-97b1-55c75abf4cb4 tempest-ServerRescueTestJSONUnderV235-503777086 tempest-ServerRescueTestJSONUnderV235-503777086-project-member] Enqueued Resource ID: 674737c3-16d2-48fa-90a6-8e057d80dc3a with Priority: HIGHEST for action security_group_members [ 1300.709054] env[65337]: INFO networking_nsxv3.common.synchronization [req-709b3fc8-7963-4ccd-b2f2-92e10f0deb2f req-bef261b3-e8df-4931-97b1-55c75abf4cb4 tempest-ServerRescueTestJSONUnderV235-503777086 tempest-ServerRescueTestJSONUnderV235-503777086-project-member] Enqueued Resource ID: 799014ab-6c8d-4784-b418-398847ad0f81 with Priority: HIGHEST for action port [ 1300.709568] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 674737c3-16d2-48fa-90a6-8e057d80dc3a with Priority: HIGHEST for action security_group_rules [ 1300.709696] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 674737c3-16d2-48fa-90a6-8e057d80dc3a with Priority: HIGHEST for action security_group_members [ 1300.709788] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 799014ab-6c8d-4784-b418-398847ad0f81 with Priority: HIGHEST for action port [ 1300.710464] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-674737c3-16d2-48fa-90a6-8e057d80dc3a taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.710595] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-674737c3-16d2-48fa-90a6-8e057d80dc3a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.710853] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-674737c3-16d2-48fa-90a6-8e057d80dc3a taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.710940] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-674737c3-16d2-48fa-90a6-8e057d80dc3a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.711130] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-799014ab-6c8d-4784-b418-398847ad0f81 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.711210] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-799014ab-6c8d-4784-b418-398847ad0f81" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.821522] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fd20e012-263e-477c-91bd-a979e5418371',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.824284] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('674737c3-16d2-48fa-90a6-8e057d80dc3a',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.838142] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.838378] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.838378] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.838570] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.852901] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1300.853837] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.855064] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1300.870155] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd20e012-263e-477c-91bd-a979e5418371 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.870402] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd20e012-263e-477c-91bd-a979e5418371" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.870546] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 799014ab-6c8d-4784-b418-398847ad0f81 with status ACTIVE [ 1300.871185] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.871185] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.871185] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.871185] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.871185] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.871499] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.871499] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.871499] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.871499] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.871658] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.871745] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.871836] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.871896] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.872046] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.872120] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.872201] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 799014ab-6c8d-4784-b418-398847ad0f81 is going to be updated. [ 1300.873502] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-674737c3-16d2-48fa-90a6-8e057d80dc3a taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.873619] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-674737c3-16d2-48fa-90a6-8e057d80dc3a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.896269] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.896537] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.896537] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.896670] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.911257] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.912282] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1300.912361] env[65337]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65337) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1300.912456] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1300.914182] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.914311] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.914379] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.914659] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.914731] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.914842] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-799014ab-6c8d-4784-b418-398847ad0f81" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.915446] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-799014ab-6c8d-4784-b418-398847ad0f81" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.915647] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-799014ab-6c8d-4784-b418-398847ad0f81" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.915780] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('799014ab-6c8d-4784-b418-398847ad0f81',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.967768] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.968070] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.968174] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.968443] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.970245] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.970532] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1301.145296] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.145518] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.145518] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.145724] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.146023] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.146288] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1301.262516] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.262731] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.262731] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.262930] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.263252] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.263888] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:43. [ 1301.263888] env[65337]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'653446ea-2b31-43b8-a920-884274265c75', 'e27d75d1-404e-406a-a69e-4560bd02b4cc', 'c043a4b4-c94d-40e1-ad4b-77d54e25a156', 'af1da677-d95a-4cec-95fa-b9208101b7dd', '161889a4-32a2-48ee-8fb7-d2a961a4b28d', 'a64509fd-193d-41f5-8257-21afcd1d96a2', '65bdf164-5da2-4e67-8ed6-85fb2021a359', '674737c3-16d2-48fa-90a6-8e057d80dc3a', 'c006a909-f4e1-43d8-bc34-4038d7937297', '7fa9655b-7006-421a-adab-fda9e0c1520c', '7b634dce-1340-436a-a5af-e7d03954de92', '2ad13511-d648-4224-8e48-ddf1ab1b8013', 'd4ff60fe-3407-42aa-b33c-6254779ad495', '6d469e76-9ef3-431d-9a07-dc20e79dbd4e', 'c62ada24-25f1-4b90-b0a4-d9a4254a91e6', 'ebb204e1-ff28-4709-a165-ad95f8c27d8b', '287fa792-d512-4fba-b686-899daae58d0e', '40a56e89-d484-4891-85a5-afa67f87b2d1', '5289c470-2cbe-4957-bd37-f39138ab0a31', '3d8e0751-3115-433f-8b5b-b20068b58d27', '303cb78d-3c85-4fcc-964c-f1082480bdd7', '5e58c2df-9a0c-45bb-b4b3-676b4af3dc2c', '85232c6c-cd42-4a15-9924-943a4e75a091', '4f8577ef-eb55-481e-9197-98761298b164', 'a4c4fbaa-f4c9-4326-babb-bda6619acdf6', '4fe2934b-ab8b-4bda-9010-1a9725b2c40c', 'c5bec24d-89af-4b5e-920b-dcaae02501f0', 'cc860d7f-b6cd-4778-bbd7-a65ff0fc5bde', 'b2e84376-5c9f-45e7-9949-59bf17a96c95', 'a5a16fe4-8172-4f86-bfcd-dba6afcdd876', '740ecd60-f1c6-4713-b339-481a878486f1', '5f3badd2-7106-4670-baaf-51e2d735f908', '846d69e3-9f9f-414f-912e-5a866002c853', '34a3f5b1-e642-4184-95f7-7ad20ed36f5b', 'b5288296-022e-4f32-a68e-bdef9f09be4e', '61142fb1-6124-4f3b-93d1-d1ec51865066', '94a13e53-dcf7-4643-ade4-8789dc9eabc4', '5f51b41c-ca91-45cf-92a6-17398a529bbb', 'c26a679a-9c5d-4a72-b91b-bd7f21348ea0', '9c4e6dd2-ce42-4c12-a876-a0055bfa44f3', 'a4a9546d-8cbc-404d-acef-d7856f353fbe', '12a747a0-2898-4059-bada-c453c5c41052', '6fd84ddb-97c2-4cc9-882e-251b1b1dd2f6'} {{(pid=65337) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1301.263888] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1301.285384] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.285622] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.285622] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.285809] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.285898] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.286016] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1301.286099] env[65337]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65337) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1301.286168] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1301.325815] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fd20e012-263e-477c-91bd-a979e5418371',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1301.326828] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('674737c3-16d2-48fa-90a6-8e057d80dc3a',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1301.370784] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.370784] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.370784] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.371356] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.372338] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.372583] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1301.372660] env[65337]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65337) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1301.372731] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1301.372867] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1301.372867] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/43 resources of Type:Security Group Rules [ 1301.372949] env[65337]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 653446ea-2b31-43b8-a920-884274265c75 with Priority: HIGH for action security_group_rules [ 1301.373033] env[65337]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e27d75d1-404e-406a-a69e-4560bd02b4cc with Priority: HIGH for action security_group_rules [ 1301.373098] env[65337]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c043a4b4-c94d-40e1-ad4b-77d54e25a156 with Priority: HIGH for action security_group_rules [ 1301.373149] env[65337]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: af1da677-d95a-4cec-95fa-b9208101b7dd with Priority: HIGH for action security_group_rules [ 1301.373290] env[65337]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d with Priority: HIGH for action security_group_rules [ 1301.373290] env[65337]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a64509fd-193d-41f5-8257-21afcd1d96a2 with Priority: HIGH for action security_group_rules [ 1301.373417] env[65337]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 65bdf164-5da2-4e67-8ed6-85fb2021a359 with Priority: HIGH for action security_group_rules [ 1301.373417] env[65337]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 674737c3-16d2-48fa-90a6-8e057d80dc3a with Priority: HIGH for action security_group_rules [ 1301.373516] env[65337]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c006a909-f4e1-43d8-bc34-4038d7937297 with Priority: HIGH for action security_group_rules [ 1301.373516] env[65337]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7fa9655b-7006-421a-adab-fda9e0c1520c with Priority: HIGH for action security_group_rules [ 1301.373604] env[65337]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7b634dce-1340-436a-a5af-e7d03954de92 with Priority: HIGH for action security_group_rules [ 1301.373604] env[65337]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2ad13511-d648-4224-8e48-ddf1ab1b8013 with Priority: HIGH for action security_group_rules [ 1301.373684] env[65337]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d4ff60fe-3407-42aa-b33c-6254779ad495 with Priority: HIGH for action security_group_rules [ 1301.373723] env[65337]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6d469e76-9ef3-431d-9a07-dc20e79dbd4e with Priority: HIGH for action security_group_rules [ 1301.373760] env[65337]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c62ada24-25f1-4b90-b0a4-d9a4254a91e6 with Priority: HIGH for action security_group_rules [ 1301.373892] env[65337]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ebb204e1-ff28-4709-a165-ad95f8c27d8b with Priority: HIGH for action security_group_rules [ 1301.373892] env[65337]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 287fa792-d512-4fba-b686-899daae58d0e with Priority: HIGH for action security_group_rules [ 1301.374030] env[65337]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 40a56e89-d484-4891-85a5-afa67f87b2d1 with Priority: HIGH for action security_group_rules [ 1301.374030] env[65337]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5289c470-2cbe-4957-bd37-f39138ab0a31 with Priority: HIGH for action security_group_rules [ 1301.374134] env[65337]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3d8e0751-3115-433f-8b5b-b20068b58d27 with Priority: HIGH for action security_group_rules [ 1301.374134] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.418582] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 799014ab-6c8d-4784-b418-398847ad0f81 with status ACTIVE [ 1301.418892] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.419113] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.419231] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.419494] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.419705] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.419941] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.420108] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.420217] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.420428] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.420556] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.420807] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.420960] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.421081] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.421309] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.421433] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.421572] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 799014ab-6c8d-4784-b418-398847ad0f81 is going to be updated. [ 1301.442847] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.443025] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.443100] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.443312] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.443449] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.443614] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-799014ab-6c8d-4784-b418-398847ad0f81" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.828415] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.828853] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.828853] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.828853] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.828980] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.829031] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd20e012-263e-477c-91bd-a979e5418371 is going to be created. [ 1301.830274] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.830403] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.830459] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.830606] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.830762] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.830762] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 674737c3-16d2-48fa-90a6-8e057d80dc3a is going to be updated. [ 1301.858403] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.858625] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.858625] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.858823] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.859045] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.863332] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.863478] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.863579] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.863790] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.864185] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.873970] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd20e012-263e-477c-91bd-a979e5418371 in Status: UNINITIALIZED for 2s [ 1301.877636] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 674737c3-16d2-48fa-90a6-8e057d80dc3a in Status: IN_PROGRESS for 2s [ 1303.250637] env[65337]: INFO networking_nsxv3.common.synchronization [req-a7dada53-6e53-4d65-8854-982395e9cde2 req-dcd7d1be-4ec3-4b49-a486-b0de80d7f452 tempest-AttachVolumeNegativeTest-935303807 tempest-AttachVolumeNegativeTest-935303807-project-member] Enqueued Resource ID: c043a4b4-c94d-40e1-ad4b-77d54e25a156 with Priority: HIGHEST for action security_group_members [ 1303.251620] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c043a4b4-c94d-40e1-ad4b-77d54e25a156 with Priority: HIGHEST for action security_group_members [ 1303.251620] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 653446ea-2b31-43b8-a920-884274265c75 with Priority: HIGH for action security_group_rules [ 1303.251620] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c043a4b4-c94d-40e1-ad4b-77d54e25a156 with Priority: HIGH for action security_group_rules [ 1303.251620] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65bdf164-5da2-4e67-8ed6-85fb2021a359 with Priority: HIGH for action security_group_rules [ 1303.252044] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c62ada24-25f1-4b90-b0a4-d9a4254a91e6 with Priority: HIGH for action security_group_rules [ 1303.252110] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d8e0751-3115-433f-8b5b-b20068b58d27 with Priority: HIGH for action security_group_rules [ 1303.252214] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5289c470-2cbe-4957-bd37-f39138ab0a31 with Priority: HIGH for action security_group_rules [ 1303.252309] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40a56e89-d484-4891-85a5-afa67f87b2d1 with Priority: HIGH for action security_group_rules [ 1303.252400] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 287fa792-d512-4fba-b686-899daae58d0e with Priority: HIGH for action security_group_rules [ 1303.252488] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d469e76-9ef3-431d-9a07-dc20e79dbd4e with Priority: HIGH for action security_group_rules [ 1303.252576] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebb204e1-ff28-4709-a165-ad95f8c27d8b with Priority: HIGH for action security_group_rules [ 1303.252662] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4ff60fe-3407-42aa-b33c-6254779ad495 with Priority: HIGH for action security_group_rules [ 1303.252749] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ad13511-d648-4224-8e48-ddf1ab1b8013 with Priority: HIGH for action security_group_rules [ 1303.252836] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b634dce-1340-436a-a5af-e7d03954de92 with Priority: HIGH for action security_group_rules [ 1303.252921] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fa9655b-7006-421a-adab-fda9e0c1520c with Priority: HIGH for action security_group_rules [ 1303.253054] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c006a909-f4e1-43d8-bc34-4038d7937297 with Priority: HIGH for action security_group_rules [ 1303.253117] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a64509fd-193d-41f5-8257-21afcd1d96a2 with Priority: HIGH for action security_group_rules [ 1303.253185] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 674737c3-16d2-48fa-90a6-8e057d80dc3a with Priority: HIGH for action security_group_rules [ 1303.253267] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d with Priority: HIGH for action security_group_rules [ 1303.253351] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e27d75d1-404e-406a-a69e-4560bd02b4cc with Priority: HIGH for action security_group_rules [ 1303.253436] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af1da677-d95a-4cec-95fa-b9208101b7dd with Priority: HIGH for action security_group_rules [ 1303.253734] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-c043a4b4-c94d-40e1-ad4b-77d54e25a156 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.253859] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c043a4b4-c94d-40e1-ad4b-77d54e25a156" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.253918] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c043a4b4-c94d-40e1-ad4b-77d54e25a156" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.256588] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c043a4b4-c94d-40e1-ad4b-77d54e25a156" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.256588] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.256588] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.256588] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.256588] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.256588] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.256588] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c043a4b4-c94d-40e1-ad4b-77d54e25a156',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.256588] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-653446ea-2b31-43b8-a920-884274265c75 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.256588] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.256588] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.256588] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.256588] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('653446ea-2b31-43b8-a920-884274265c75',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.257289] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c043a4b4-c94d-40e1-ad4b-77d54e25a156 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.257289] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c043a4b4-c94d-40e1-ad4b-77d54e25a156" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.257289] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c043a4b4-c94d-40e1-ad4b-77d54e25a156" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.257289] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c043a4b4-c94d-40e1-ad4b-77d54e25a156" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.257448] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c043a4b4-c94d-40e1-ad4b-77d54e25a156',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.262265] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-65bdf164-5da2-4e67-8ed6-85fb2021a359 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.262407] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-65bdf164-5da2-4e67-8ed6-85fb2021a359" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.262474] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-65bdf164-5da2-4e67-8ed6-85fb2021a359" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.262666] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-65bdf164-5da2-4e67-8ed6-85fb2021a359" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.262754] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('65bdf164-5da2-4e67-8ed6-85fb2021a359',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.263797] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c62ada24-25f1-4b90-b0a4-d9a4254a91e6 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.263797] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c62ada24-25f1-4b90-b0a4-d9a4254a91e6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.263937] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c62ada24-25f1-4b90-b0a4-d9a4254a91e6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.263975] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c62ada24-25f1-4b90-b0a4-d9a4254a91e6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.265796] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c62ada24-25f1-4b90-b0a4-d9a4254a91e6',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.269171] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3d8e0751-3115-433f-8b5b-b20068b58d27 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.269171] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3d8e0751-3115-433f-8b5b-b20068b58d27" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.269171] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3d8e0751-3115-433f-8b5b-b20068b58d27" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.269171] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3d8e0751-3115-433f-8b5b-b20068b58d27" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.269171] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3d8e0751-3115-433f-8b5b-b20068b58d27',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.269769] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5289c470-2cbe-4957-bd37-f39138ab0a31 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.269884] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5289c470-2cbe-4957-bd37-f39138ab0a31" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.269943] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5289c470-2cbe-4957-bd37-f39138ab0a31" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.270120] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5289c470-2cbe-4957-bd37-f39138ab0a31" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.270191] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5289c470-2cbe-4957-bd37-f39138ab0a31',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.270902] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-40a56e89-d484-4891-85a5-afa67f87b2d1 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.271023] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-40a56e89-d484-4891-85a5-afa67f87b2d1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.271265] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-40a56e89-d484-4891-85a5-afa67f87b2d1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.271438] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-40a56e89-d484-4891-85a5-afa67f87b2d1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.271513] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('40a56e89-d484-4891-85a5-afa67f87b2d1',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.272878] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-287fa792-d512-4fba-b686-899daae58d0e taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.273105] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-287fa792-d512-4fba-b686-899daae58d0e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.273105] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-287fa792-d512-4fba-b686-899daae58d0e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.273267] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-287fa792-d512-4fba-b686-899daae58d0e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.273312] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('287fa792-d512-4fba-b686-899daae58d0e',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.274093] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6d469e76-9ef3-431d-9a07-dc20e79dbd4e taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.274894] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6d469e76-9ef3-431d-9a07-dc20e79dbd4e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.274894] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6d469e76-9ef3-431d-9a07-dc20e79dbd4e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.274894] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6d469e76-9ef3-431d-9a07-dc20e79dbd4e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.276081] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6d469e76-9ef3-431d-9a07-dc20e79dbd4e',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.276081] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ebb204e1-ff28-4709-a165-ad95f8c27d8b taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.276081] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ebb204e1-ff28-4709-a165-ad95f8c27d8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.276589] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ebb204e1-ff28-4709-a165-ad95f8c27d8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.276783] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ebb204e1-ff28-4709-a165-ad95f8c27d8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.276879] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ebb204e1-ff28-4709-a165-ad95f8c27d8b',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.278476] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d4ff60fe-3407-42aa-b33c-6254779ad495 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.278683] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d4ff60fe-3407-42aa-b33c-6254779ad495" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.278753] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d4ff60fe-3407-42aa-b33c-6254779ad495" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.279362] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d4ff60fe-3407-42aa-b33c-6254779ad495" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.279484] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d4ff60fe-3407-42aa-b33c-6254779ad495',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.280845] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2ad13511-d648-4224-8e48-ddf1ab1b8013 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.280981] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2ad13511-d648-4224-8e48-ddf1ab1b8013" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.280981] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2ad13511-d648-4224-8e48-ddf1ab1b8013" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.281421] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2ad13511-d648-4224-8e48-ddf1ab1b8013" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.281507] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2ad13511-d648-4224-8e48-ddf1ab1b8013',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.283108] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7b634dce-1340-436a-a5af-e7d03954de92 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.283198] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7b634dce-1340-436a-a5af-e7d03954de92" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.283291] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7b634dce-1340-436a-a5af-e7d03954de92" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.283528] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7b634dce-1340-436a-a5af-e7d03954de92" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.283528] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7b634dce-1340-436a-a5af-e7d03954de92',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.284268] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7fa9655b-7006-421a-adab-fda9e0c1520c taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.284884] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7fa9655b-7006-421a-adab-fda9e0c1520c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.285361] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7fa9655b-7006-421a-adab-fda9e0c1520c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.285361] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7fa9655b-7006-421a-adab-fda9e0c1520c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.285361] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7fa9655b-7006-421a-adab-fda9e0c1520c',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.287458] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c006a909-f4e1-43d8-bc34-4038d7937297 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.287458] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c006a909-f4e1-43d8-bc34-4038d7937297" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.287458] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c006a909-f4e1-43d8-bc34-4038d7937297" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.287856] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c006a909-f4e1-43d8-bc34-4038d7937297" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.287856] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c006a909-f4e1-43d8-bc34-4038d7937297',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.289470] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a64509fd-193d-41f5-8257-21afcd1d96a2 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.289609] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a64509fd-193d-41f5-8257-21afcd1d96a2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.289672] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a64509fd-193d-41f5-8257-21afcd1d96a2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.289871] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a64509fd-193d-41f5-8257-21afcd1d96a2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.289983] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a64509fd-193d-41f5-8257-21afcd1d96a2',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.290818] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-674737c3-16d2-48fa-90a6-8e057d80dc3a taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.290943] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-674737c3-16d2-48fa-90a6-8e057d80dc3a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.291575] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-161889a4-32a2-48ee-8fb7-d2a961a4b28d taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.291763] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.291877] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.292041] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.292141] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('161889a4-32a2-48ee-8fb7-d2a961a4b28d',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.293095] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e27d75d1-404e-406a-a69e-4560bd02b4cc taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.293204] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e27d75d1-404e-406a-a69e-4560bd02b4cc" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.293270] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e27d75d1-404e-406a-a69e-4560bd02b4cc" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.294578] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e27d75d1-404e-406a-a69e-4560bd02b4cc" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.294578] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e27d75d1-404e-406a-a69e-4560bd02b4cc',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.294578] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-af1da677-d95a-4cec-95fa-b9208101b7dd taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.294578] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.294578] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.294874] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.294874] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('af1da677-d95a-4cec-95fa-b9208101b7dd',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.799265] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fa9655b-7006-421a-adab-fda9e0c1520c taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.799517] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fa9655b-7006-421a-adab-fda9e0c1520c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.799517] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fa9655b-7006-421a-adab-fda9e0c1520c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.799689] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fa9655b-7006-421a-adab-fda9e0c1520c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.799847] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.799949] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.800050] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.800212] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.800305] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.800395] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fa9655b-7006-421a-adab-fda9e0c1520c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.800484] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7fa9655b-7006-421a-adab-fda9e0c1520c',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.806216] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.806409] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.806409] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.806564] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.807474] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-a64509fd-193d-41f5-8257-21afcd1d96a2 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.807589] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a64509fd-193d-41f5-8257-21afcd1d96a2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.807656] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a64509fd-193d-41f5-8257-21afcd1d96a2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.807819] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a64509fd-193d-41f5-8257-21afcd1d96a2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.807967] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.808078] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.808142] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.808291] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.808371] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.808459] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a64509fd-193d-41f5-8257-21afcd1d96a2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.808546] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a64509fd-193d-41f5-8257-21afcd1d96a2',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.830199] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a64509fd-193d-41f5-8257-21afcd1d96a2',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.862852] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.863174] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.868916] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.869119] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.869969] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.870086] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.879917] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.879917] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.880785] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.880878] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.882533] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.882633] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.883777] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.883873] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.884596] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.884753] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.885840] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.885973] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.886520] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd20e012-263e-477c-91bd-a979e5418371 in Status: SUCCESS [ 1303.886699] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd20e012-263e-477c-91bd-a979e5418371" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.887443] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.887583] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.887649] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd20e012-263e-477c-91bd-a979e5418371" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.887890] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd20e012-263e-477c-91bd-a979e5418371" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.888063] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.888171] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.888226] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.888388] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.888467] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.888557] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd20e012-263e-477c-91bd-a979e5418371',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.890100] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.890100] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.890628] env[65337]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1303.891084] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.891171] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.891743] env[65337]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1303.892165] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.892260] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.892907] env[65337]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1303.893192] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.893283] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.893857] env[65337]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1303.894240] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.894325] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.894914] env[65337]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1303.895306] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.895415] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.896058] env[65337]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1303.896459] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.896662] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.896848] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.896895] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.897184] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.897290] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.897382] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c043a4b4-c94d-40e1-ad4b-77d54e25a156 is going to be updated. [ 1303.898917] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 674737c3-16d2-48fa-90a6-8e057d80dc3a in Status: SUCCESS [ 1303.899552] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-674737c3-16d2-48fa-90a6-8e057d80dc3a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.899832] env[65337]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1303.900187] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.900301] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.900357] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.900541] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.902213] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-674737c3-16d2-48fa-90a6-8e057d80dc3a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.902379] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-674737c3-16d2-48fa-90a6-8e057d80dc3a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.902530] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.902632] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.902692] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.902833] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.902911] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.903012] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('674737c3-16d2-48fa-90a6-8e057d80dc3a',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.926132] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.926132] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 287fa792-d512-4fba-b686-899daae58d0e is going to be deleted. [ 1303.926651] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.926651] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.934243] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.934421] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.934472] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.934636] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.934773] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.942393] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c043a4b4-c94d-40e1-ad4b-77d54e25a156 in Status: IN_PROGRESS for 2s [ 1303.946986] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.947391] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7b634dce-1340-436a-a5af-e7d03954de92 is going to be deleted. [ 1303.948120] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.948318] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.969466] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.969709] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c006a909-f4e1-43d8-bc34-4038d7937297 is going to be deleted. [ 1303.970569] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.970780] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.988769] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.988975] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.990918] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.991052] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ebb204e1-ff28-4709-a165-ad95f8c27d8b is going to be deleted. [ 1303.991918] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.992141] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.004738] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.004738] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.012582] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.012743] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 40a56e89-d484-4891-85a5-afa67f87b2d1 is going to be deleted. [ 1304.014043] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.014199] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.052785] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.052955] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: af1da677-d95a-4cec-95fa-b9208101b7dd is going to be deleted. [ 1304.053964] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.054214] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.099284] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.099284] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.106567] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.106567] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.113574] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.113756] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.116381] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.116524] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c62ada24-25f1-4b90-b0a4-d9a4254a91e6 is going to be deleted. [ 1304.117629] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.118290] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.152712] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.152712] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e27d75d1-404e-406a-a69e-4560bd02b4cc is going to be deleted. [ 1304.153581] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.154672] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.177888] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.177965] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.206860] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.207059] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 161889a4-32a2-48ee-8fb7-d2a961a4b28d is going to be deleted. [ 1304.207986] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.208224] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.285405] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.286063] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.304415] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7fa9655b-7006-421a-adab-fda9e0c1520c',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.320723] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.320898] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3d8e0751-3115-433f-8b5b-b20068b58d27 is going to be deleted. [ 1304.321911] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.322104] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.333643] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a64509fd-193d-41f5-8257-21afcd1d96a2: rpc.has_security_group_logging(os_id): False [ 1304.355252] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.355499] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.365886] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.366064] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.370991] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.371206] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6d469e76-9ef3-431d-9a07-dc20e79dbd4e is going to be deleted. [ 1304.372619] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.372934] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.373101] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.373257] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c043a4b4-c94d-40e1-ad4b-77d54e25a156 is going to be deleted. [ 1304.374433] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.374639] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.386344] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.386475] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.399302] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.399496] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.405943] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('674737c3-16d2-48fa-90a6-8e057d80dc3a',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.541075] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.541075] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 65bdf164-5da2-4e67-8ed6-85fb2021a359 is going to be deleted. [ 1304.541290] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.541506] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.614018] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.614229] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.619596] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.619784] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.633528] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.633759] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.646916] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.647124] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5289c470-2cbe-4957-bd37-f39138ab0a31 is going to be deleted. [ 1304.648214] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.648457] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.701669] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.701900] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.719835] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.720196] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2ad13511-d648-4224-8e48-ddf1ab1b8013 is going to be deleted. [ 1304.721263] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.721833] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.807579] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7fa9655b-7006-421a-adab-fda9e0c1520c: rpc.has_security_group_logging(os_id): False [ 1304.816095] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.816296] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 653446ea-2b31-43b8-a920-884274265c75 is going to be deleted. [ 1304.817410] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.817640] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.826050] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.826222] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.838520] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.838657] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d4ff60fe-3407-42aa-b33c-6254779ad495 is going to be deleted. [ 1304.839619] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.839835] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.839930] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.840089] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-287fa792-d512-4fba-b686-899daae58d0e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.840216] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.840367] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.840448] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.840561] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7b634dce-1340-436a-a5af-e7d03954de92" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.841124] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.841321] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.843041] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.843041] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c006a909-f4e1-43d8-bc34-4038d7937297" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.843041] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.843041] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.843041] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.843308] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ebb204e1-ff28-4709-a165-ad95f8c27d8b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.843394] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.843710] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.843861] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.844064] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-40a56e89-d484-4891-85a5-afa67f87b2d1" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.844308] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.844510] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.844628] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.844839] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-af1da677-d95a-4cec-95fa-b9208101b7dd" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.844984] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.845320] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.845405] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.845536] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c62ada24-25f1-4b90-b0a4-d9a4254a91e6" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.845670] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.845813] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.845891] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.846013] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-161889a4-32a2-48ee-8fb7-d2a961a4b28d" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.846754] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.847127] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.847270] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.847465] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e27d75d1-404e-406a-a69e-4560bd02b4cc" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.847682] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.848035] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.850681] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.850681] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.892310] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.892735] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.892860] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.892904] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.893168] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.893259] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.893460] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a64509fd-193d-41f5-8257-21afcd1d96a2 is going to be updated. [ 1304.895019] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.895218] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.895309] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.895520] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.895639] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.895699] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.895845] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.895921] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.896016] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd20e012-263e-477c-91bd-a979e5418371 is going to be deleted. [ 1304.896847] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.897120] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.897120] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.897263] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6d469e76-9ef3-431d-9a07-dc20e79dbd4e" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.897462] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.897584] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.897584] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.897745] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c043a4b4-c94d-40e1-ad4b-77d54e25a156" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.897912] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.897975] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.898024] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.898140] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3d8e0751-3115-433f-8b5b-b20068b58d27" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.898768] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.899140] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.899140] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.899140] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-65bdf164-5da2-4e67-8ed6-85fb2021a359" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.899526] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.899640] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.899713] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.899816] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5289c470-2cbe-4957-bd37-f39138ab0a31" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.899949] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.900132] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.908610] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('674737c3-16d2-48fa-90a6-8e057d80dc3a',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.932052] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.932524] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.935017] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.935175] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.949088] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.949431] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.949564] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.949612] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.949796] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.949973] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.949973] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7fa9655b-7006-421a-adab-fda9e0c1520c is going to be updated. [ 1304.951046] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.951207] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.951293] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.951406] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2ad13511-d648-4224-8e48-ddf1ab1b8013" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.951869] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.952048] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.952153] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.952515] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-653446ea-2b31-43b8-a920-884274265c75" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.973864] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.974120] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.974120] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.974288] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.974379] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.974477] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd20e012-263e-477c-91bd-a979e5418371" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.974627] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd20e012-263e-477c-91bd-a979e5418371" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.974823] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd20e012-263e-477c-91bd-a979e5418371" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.974971] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.975129] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.975200] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.975346] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.975438] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.975534] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd20e012-263e-477c-91bd-a979e5418371',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.987620] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.987828] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.987828] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.988018] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.988113] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.988230] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d4ff60fe-3407-42aa-b33c-6254779ad495" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.030998] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.031268] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.031268] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.031469] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.031618] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.060859] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a64509fd-193d-41f5-8257-21afcd1d96a2 in Status: IN_PROGRESS for 2s [ 1305.166838] env[65337]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1305.167497] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.167657] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.167750] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.168087] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.168297] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.183482] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7fa9655b-7006-421a-adab-fda9e0c1520c in Status: IN_PROGRESS for 2s [ 1305.410791] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.411248] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.411248] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.411336] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.411467] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.411583] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 674737c3-16d2-48fa-90a6-8e057d80dc3a is going to be updated. [ 1305.439521] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.439779] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.439779] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.439948] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.440116] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.453176] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 674737c3-16d2-48fa-90a6-8e057d80dc3a in Status: IN_PROGRESS for 2s [ 1305.477753] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.477967] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.478127] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.478299] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.478365] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.478567] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.478667] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.478724] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.478863] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.478931] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.479029] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd20e012-263e-477c-91bd-a979e5418371 already deleted. [ 1305.479134] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd20e012-263e-477c-91bd-a979e5418371" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.479259] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd20e012-263e-477c-91bd-a979e5418371" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.479399] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd20e012-263e-477c-91bd-a979e5418371" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.479542] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.479634] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.479692] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.479821] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.479889] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.480097] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd20e012-263e-477c-91bd-a979e5418371',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.889206] env[65337]: INFO networking_nsxv3.common.synchronization [req-e065d6ba-e38d-4878-b430-99340c96bc65 req-84ba1b1b-5e6b-428f-8d45-2ac9822c9553 tempest-ServerRescueTestJSONUnderV235-503777086 tempest-ServerRescueTestJSONUnderV235-503777086-project-member] Enqueued Resource ID: 674737c3-16d2-48fa-90a6-8e057d80dc3a with Priority: HIGHEST for action security_group_members [ 1305.889725] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 674737c3-16d2-48fa-90a6-8e057d80dc3a with Priority: HIGHEST for action security_group_members [ 1305.890040] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-674737c3-16d2-48fa-90a6-8e057d80dc3a taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.890150] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-674737c3-16d2-48fa-90a6-8e057d80dc3a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.953793] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c043a4b4-c94d-40e1-ad4b-77d54e25a156 in Status: SUCCESS [ 1305.954355] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c043a4b4-c94d-40e1-ad4b-77d54e25a156 deletion is rescheduled due to dependency. [ 1305.954355] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c043a4b4-c94d-40e1-ad4b-77d54e25a156" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.982474] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.982669] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.982669] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.982886] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.982977] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.983188] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.983305] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.983348] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.983489] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.983561] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.983649] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd20e012-263e-477c-91bd-a979e5418371 already deleted. [ 1305.983726] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd20e012-263e-477c-91bd-a979e5418371" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.983852] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fd20e012-263e-477c-91bd-a979e5418371',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1306.486429] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fd20e012-263e-477c-91bd-a979e5418371',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1306.988359] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fd20e012-263e-477c-91bd-a979e5418371: rpc.has_security_group_logging(os_id): False [ 1307.005828] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.005999] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.006071] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.006280] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.006369] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.006570] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.006663] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.006725] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.007199] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.007199] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.007199] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fd20e012-263e-477c-91bd-a979e5418371 is going to be created. [ 1307.022483] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/fd20e012-263e-477c-91bd-a979e5418371], does not exist path=[/infra/domains/default/groups/fd20e012-263e-477c-91bd-a979e5418371]."\n}' [ 1307.022730] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fd20e012-263e-477c-91bd-a979e5418371 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/fd20e012-263e-477c-91bd-a979e5418371 [ 1307.022730] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1307.057392] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.057623] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.057623] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.057824] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.058489] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.058754] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.058863] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.058932] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.059121] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.059202] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.059376] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.059470] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.059535] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.059675] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.059752] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.059840] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fd20e012-263e-477c-91bd-a979e5418371 is going to be created. [ 1307.078159] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a64509fd-193d-41f5-8257-21afcd1d96a2 in Status: SUCCESS [ 1307.078386] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a64509fd-193d-41f5-8257-21afcd1d96a2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.079854] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/fd20e012-263e-477c-91bd-a979e5418371], does not exist path=[/infra/domains/default/groups/fd20e012-263e-477c-91bd-a979e5418371]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/fd20e012-263e-477c-91bd-a979e5418371 [ 1307.080024] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fd20e012-263e-477c-91bd-a979e5418371" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.080228] env[65337]: Traceback (most recent call last): [ 1307.080276] env[65337]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 1307.080276] env[65337]: return func(*args, **kwargs) [ 1307.080276] env[65337]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 1307.080276] env[65337]: res.raise_for_status() [ 1307.080276] env[65337]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 1307.080276] env[65337]: raise HTTPError(http_error_msg, response=self) [ 1307.080276] env[65337]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/fd20e012-263e-477c-91bd-a979e5418371 [ 1307.080276] env[65337]: During handling of the above exception, another exception occurred: [ 1307.080276] env[65337]: Traceback (most recent call last): [ 1307.080276] env[65337]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 1307.080276] env[65337]: listener.cb(fileno) [ 1307.080276] env[65337]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 1307.080276] env[65337]: result = function(*args, **kwargs) [ 1307.080276] env[65337]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 1307.080276] env[65337]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 1307.080276] env[65337]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 1307.080276] env[65337]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 1307.080276] env[65337]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 1307.080276] env[65337]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 1307.080945] env[65337]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 1307.080945] env[65337]: res.raise_for_status() [ 1307.080945] env[65337]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 1307.080945] env[65337]: raise HTTPError(http_error_msg, response=self) [ 1307.080945] env[65337]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/fd20e012-263e-477c-91bd-a979e5418371 [ 1307.080945] env[65337]: Removing descriptor: 15 [ 1307.195961] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7fa9655b-7006-421a-adab-fda9e0c1520c in Status: SUCCESS [ 1307.196166] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7fa9655b-7006-421a-adab-fda9e0c1520c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.464070] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 674737c3-16d2-48fa-90a6-8e057d80dc3a in Status: SUCCESS [ 1307.464274] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-674737c3-16d2-48fa-90a6-8e057d80dc3a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.464475] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-674737c3-16d2-48fa-90a6-8e057d80dc3a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.464830] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-674737c3-16d2-48fa-90a6-8e057d80dc3a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.465089] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.465243] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.465336] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.465554] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.465683] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.465796] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('674737c3-16d2-48fa-90a6-8e057d80dc3a',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1307.968244] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.968553] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.968553] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.968705] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.988543] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.988838] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.989146] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.989146] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.989327] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.989393] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.989516] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 674737c3-16d2-48fa-90a6-8e057d80dc3a is going to be updated. [ 1308.021825] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.022034] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.022085] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.022290] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.022456] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.032241] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 674737c3-16d2-48fa-90a6-8e057d80dc3a in Status: IN_PROGRESS for 2s [ 1310.044365] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 674737c3-16d2-48fa-90a6-8e057d80dc3a in Status: SUCCESS [ 1310.044365] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 674737c3-16d2-48fa-90a6-8e057d80dc3a deletion is rescheduled due to dependency. [ 1310.044365] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-674737c3-16d2-48fa-90a6-8e057d80dc3a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.044365] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-674737c3-16d2-48fa-90a6-8e057d80dc3a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.044831] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-674737c3-16d2-48fa-90a6-8e057d80dc3a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.044831] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.044831] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.044831] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.045013] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.045013] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.045251] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('674737c3-16d2-48fa-90a6-8e057d80dc3a',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.547622] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.547892] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.548040] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.548367] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.548530] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.548844] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.549017] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.549154] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.549410] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.549560] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.550056] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 674737c3-16d2-48fa-90a6-8e057d80dc3a is going to be updated. [ 1310.581568] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.581828] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.581970] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.582305] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.582561] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.591104] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 674737c3-16d2-48fa-90a6-8e057d80dc3a in Status: IN_PROGRESS for 2s [ 1310.891462] env[65337]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1310.891462] env[65337]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=5 [ 1312.601843] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 674737c3-16d2-48fa-90a6-8e057d80dc3a in Status: SUCCESS [ 1312.602129] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 674737c3-16d2-48fa-90a6-8e057d80dc3a deletion is rescheduled due to dependency. [ 1312.602171] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-674737c3-16d2-48fa-90a6-8e057d80dc3a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.602338] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-674737c3-16d2-48fa-90a6-8e057d80dc3a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.602667] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-674737c3-16d2-48fa-90a6-8e057d80dc3a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.602747] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.602906] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.602942] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.603848] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.603848] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.603848] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-674737c3-16d2-48fa-90a6-8e057d80dc3a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.603848] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('674737c3-16d2-48fa-90a6-8e057d80dc3a',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1312.606350] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-674737c3-16d2-48fa-90a6-8e057d80dc3a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.606443] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-674737c3-16d2-48fa-90a6-8e057d80dc3a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.609472] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.609472] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.609472] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.609472] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.609472] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.609472] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('674737c3-16d2-48fa-90a6-8e057d80dc3a',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1313.109264] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-674737c3-16d2-48fa-90a6-8e057d80dc3a taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.109496] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-674737c3-16d2-48fa-90a6-8e057d80dc3a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.111966] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.112132] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.112217] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.112491] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.112615] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.112856] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.112991] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.113111] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.113330] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.113452] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.113579] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 674737c3-16d2-48fa-90a6-8e057d80dc3a is going to be updated. [ 1313.143622] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.143622] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.143622] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.143622] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.143982] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.153319] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 674737c3-16d2-48fa-90a6-8e057d80dc3a in Status: IN_PROGRESS for 2s [ 1315.016957] env[65337]: INFO networking_nsxv3.common.synchronization [req-461a90ca-9693-4df7-a44a-203489d791fb req-38b9a322-573e-4902-82d0-142a0aa86d6d tempest-AttachVolumeNegativeTest-935303807 tempest-AttachVolumeNegativeTest-935303807-project-member] Enqueued Resource ID: 7fa9655b-7006-421a-adab-fda9e0c1520c with Priority: HIGHEST for action security_group_members [ 1315.017571] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fa9655b-7006-421a-adab-fda9e0c1520c with Priority: HIGHEST for action security_group_members [ 1315.017908] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fa9655b-7006-421a-adab-fda9e0c1520c taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.018047] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fa9655b-7006-421a-adab-fda9e0c1520c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.018113] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fa9655b-7006-421a-adab-fda9e0c1520c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.018311] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fa9655b-7006-421a-adab-fda9e0c1520c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.018472] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.018572] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.018629] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.018773] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.018857] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.018950] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fa9655b-7006-421a-adab-fda9e0c1520c',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1315.166185] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 674737c3-16d2-48fa-90a6-8e057d80dc3a in Status: SUCCESS [ 1315.166469] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 674737c3-16d2-48fa-90a6-8e057d80dc3a deletion is rescheduled due to dependency. [ 1315.166587] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-674737c3-16d2-48fa-90a6-8e057d80dc3a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.166729] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-674737c3-16d2-48fa-90a6-8e057d80dc3a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.167079] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-674737c3-16d2-48fa-90a6-8e057d80dc3a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.167329] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.167477] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.167564] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.167765] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.167879] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.168018] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-674737c3-16d2-48fa-90a6-8e057d80dc3a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.168222] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-674737c3-16d2-48fa-90a6-8e057d80dc3a taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.168447] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-674737c3-16d2-48fa-90a6-8e057d80dc3a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.168519] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-674737c3-16d2-48fa-90a6-8e057d80dc3a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.168681] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-674737c3-16d2-48fa-90a6-8e057d80dc3a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.168851] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.169789] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.169789] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.169789] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.169789] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.169789] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-674737c3-16d2-48fa-90a6-8e057d80dc3a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.169789] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('674737c3-16d2-48fa-90a6-8e057d80dc3a',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1315.522036] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.522292] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.522395] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.522650] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.547488] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.547757] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.547870] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.547946] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.548162] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.548246] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.548351] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fa9655b-7006-421a-adab-fda9e0c1520c is going to be updated. [ 1315.575201] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.575422] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.575422] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.575631] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.575775] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.585539] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fa9655b-7006-421a-adab-fda9e0c1520c in Status: IN_PROGRESS for 2s [ 1315.672475] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 674737c3-16d2-48fa-90a6-8e057d80dc3a: rpc.has_security_group_logging(os_id): False [ 1315.691947] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.692514] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.692672] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.693024] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.693024] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.693284] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.693408] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.693472] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.693645] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.693731] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.693951] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.694074] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.694167] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.694343] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.694422] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.694623] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.694777] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.694886] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.695066] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.695145] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.695253] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 674737c3-16d2-48fa-90a6-8e057d80dc3a is going to be updated. [ 1315.771943] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.772051] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.772104] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.772320] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.772507] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.786682] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 674737c3-16d2-48fa-90a6-8e057d80dc3a in Status: IN_PROGRESS for 2s [ 1317.595339] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fa9655b-7006-421a-adab-fda9e0c1520c in Status: SUCCESS [ 1317.595727] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fa9655b-7006-421a-adab-fda9e0c1520c deletion is rescheduled due to dependency. [ 1317.595727] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fa9655b-7006-421a-adab-fda9e0c1520c" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.800987] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 674737c3-16d2-48fa-90a6-8e057d80dc3a in Status: SUCCESS [ 1317.801233] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-674737c3-16d2-48fa-90a6-8e057d80dc3a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.801408] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-674737c3-16d2-48fa-90a6-8e057d80dc3a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.801627] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-674737c3-16d2-48fa-90a6-8e057d80dc3a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.801718] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('674737c3-16d2-48fa-90a6-8e057d80dc3a',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1318.325026] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.325026] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.325026] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.325026] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.325026] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.325026] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 674737c3-16d2-48fa-90a6-8e057d80dc3a is going to be deleted. [ 1318.377386] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.377588] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.377635] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.377839] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.377936] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.378070] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-674737c3-16d2-48fa-90a6-8e057d80dc3a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.378221] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-674737c3-16d2-48fa-90a6-8e057d80dc3a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.378380] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-674737c3-16d2-48fa-90a6-8e057d80dc3a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.378460] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('674737c3-16d2-48fa-90a6-8e057d80dc3a',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1318.901077] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.901457] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.901457] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.901537] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.901575] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.901688] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 674737c3-16d2-48fa-90a6-8e057d80dc3a already deleted. [ 1318.901757] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-674737c3-16d2-48fa-90a6-8e057d80dc3a" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.697853] env[65337]: INFO networking_nsxv3.common.synchronization [None req-89315c3e-81db-4428-85e3-485991cff865 tempest-AttachVolumeNegativeTest-935303807 tempest-AttachVolumeNegativeTest-935303807-project-member] Enqueued Resource ID: 5b54320b-d8ad-4e2d-b8c1-f8f15dccb0a9 with Priority: HIGHEST for action security_group_rules [ 1319.698683] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b54320b-d8ad-4e2d-b8c1-f8f15dccb0a9 with Priority: HIGHEST for action security_group_rules [ 1319.698683] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5b54320b-d8ad-4e2d-b8c1-f8f15dccb0a9 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.698800] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5b54320b-d8ad-4e2d-b8c1-f8f15dccb0a9" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.698896] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5b54320b-d8ad-4e2d-b8c1-f8f15dccb0a9" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.699542] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5b54320b-d8ad-4e2d-b8c1-f8f15dccb0a9" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.699624] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5b54320b-d8ad-4e2d-b8c1-f8f15dccb0a9',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1319.776048] env[65337]: INFO networking_nsxv3.common.synchronization [None req-b3ae8469-c64b-4f7b-be90-3832c8de9661 tempest-AttachVolumeNegativeTest-935303807 tempest-AttachVolumeNegativeTest-935303807-project-member] Enqueued Resource ID: 5b54320b-d8ad-4e2d-b8c1-f8f15dccb0a9 with Priority: HIGHEST for action security_group_rules [ 1319.776356] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b54320b-d8ad-4e2d-b8c1-f8f15dccb0a9 with Priority: HIGHEST for action security_group_rules [ 1319.776670] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5b54320b-d8ad-4e2d-b8c1-f8f15dccb0a9 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.776765] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5b54320b-d8ad-4e2d-b8c1-f8f15dccb0a9" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.218966] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.219253] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.219253] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.219403] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.219491] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.219587] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5b54320b-d8ad-4e2d-b8c1-f8f15dccb0a9 already deleted. [ 1320.219670] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5b54320b-d8ad-4e2d-b8c1-f8f15dccb0a9" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.219822] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5b54320b-d8ad-4e2d-b8c1-f8f15dccb0a9" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.219971] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5b54320b-d8ad-4e2d-b8c1-f8f15dccb0a9" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.220067] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5b54320b-d8ad-4e2d-b8c1-f8f15dccb0a9',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1320.702398] env[65337]: INFO networking_nsxv3.common.synchronization [req-601b19a3-265a-4076-80c2-59b198fac8fe req-d70b89aa-7ce3-4694-95fd-61e03944ad78 tempest-ServerActionsTestJSON-704073373 tempest-ServerActionsTestJSON-704073373-project-member] Enqueued Resource ID: 5f51b41c-ca91-45cf-92a6-17398a529bbb with Priority: HIGHEST for action security_group_members [ 1320.702947] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f51b41c-ca91-45cf-92a6-17398a529bbb with Priority: HIGHEST for action security_group_members [ 1320.703300] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f51b41c-ca91-45cf-92a6-17398a529bbb taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.705017] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f51b41c-ca91-45cf-92a6-17398a529bbb" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.705017] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f51b41c-ca91-45cf-92a6-17398a529bbb" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.705017] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f51b41c-ca91-45cf-92a6-17398a529bbb" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.705017] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.705017] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.705017] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.705017] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.705017] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.705017] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5f51b41c-ca91-45cf-92a6-17398a529bbb',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1320.739964] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.740159] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.740228] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.740460] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.740553] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.740666] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5b54320b-d8ad-4e2d-b8c1-f8f15dccb0a9 already deleted. [ 1320.740764] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5b54320b-d8ad-4e2d-b8c1-f8f15dccb0a9" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.206411] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.206599] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.206599] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.206946] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.226353] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.226683] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.226751] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.226809] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.227141] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.227265] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.227384] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5f51b41c-ca91-45cf-92a6-17398a529bbb is going to be updated. [ 1321.252510] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.252700] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.252700] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.252916] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.253094] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.260870] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f51b41c-ca91-45cf-92a6-17398a529bbb in Status: IN_PROGRESS for 2s [ 1323.271666] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f51b41c-ca91-45cf-92a6-17398a529bbb in Status: SUCCESS [ 1323.271666] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5f51b41c-ca91-45cf-92a6-17398a529bbb deletion is rescheduled due to dependency. [ 1323.271666] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f51b41c-ca91-45cf-92a6-17398a529bbb" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.201438] env[65337]: INFO networking_nsxv3.common.synchronization [req-806a4d8f-a9b4-4dc7-8fa1-448321439f67 req-c2e30462-8d7b-46fb-88e7-66252992a0d8 tempest-AttachVolumeNegativeTest-935303807 tempest-AttachVolumeNegativeTest-935303807-project-member] Enqueued Resource ID: 5b54320b-d8ad-4e2d-b8c1-f8f15dccb0a9 with Priority: HIGHEST for action security_group_members [ 1325.204577] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b54320b-d8ad-4e2d-b8c1-f8f15dccb0a9 with Priority: HIGHEST for action security_group_members [ 1325.204577] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b54320b-d8ad-4e2d-b8c1-f8f15dccb0a9 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.204577] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b54320b-d8ad-4e2d-b8c1-f8f15dccb0a9" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.204577] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b54320b-d8ad-4e2d-b8c1-f8f15dccb0a9" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.204577] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b54320b-d8ad-4e2d-b8c1-f8f15dccb0a9" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.204577] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.204577] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.204577] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.204577] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.204577] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.204577] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b54320b-d8ad-4e2d-b8c1-f8f15dccb0a9',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1325.494453] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock network-61 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.494702] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "network-61" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.494792] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "network-61" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.495097] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "network-61" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.495368] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.495528] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.495644] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.495864] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.496018] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.496234] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1325.496344] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1325.496449] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1325.496554] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1325.496662] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1325.496765] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1325.496905] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1325.520082] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1325.520082] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1325.520364] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1325.520626] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "network-61" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.521137] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock port-e86942d6-20f2-4639-9318-1fca623ba0ff taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.521433] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "port-e86942d6-20f2-4639-9318-1fca623ba0ff" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.521648] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "port-e86942d6-20f2-4639-9318-1fca623ba0ff" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.522146] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "port-e86942d6-20f2-4639-9318-1fca623ba0ff" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.522388] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e86942d6-20f2-4639-9318-1fca623ba0ff',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1325.706969] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.707270] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.707270] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.707473] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.707585] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.707811] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.707946] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.708020] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.708204] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.708306] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.708402] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b54320b-d8ad-4e2d-b8c1-f8f15dccb0a9 already deleted. [ 1325.708489] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b54320b-d8ad-4e2d-b8c1-f8f15dccb0a9" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.025644] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.025894] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.025894] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.026208] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.026405] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.026584] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Segment Port e86942d6-20f2-4639-9318-1fca623ba0ff not found, creating... [ 1326.028026] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.028202] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.028478] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.029115] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.029299] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.030572] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.030745] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.031051] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.031864] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.032108] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.032384] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Resource: SegmentPort with ID: e86942d6-20f2-4639-9318-1fca623ba0ff is going to be created. [ 1326.055197] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.055523] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.055639] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.055958] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.056246] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.056616] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "port-e86942d6-20f2-4639-9318-1fca623ba0ff" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.769328] env[65337]: INFO networking_nsxv3.common.synchronization [req-806a4d8f-a9b4-4dc7-8fa1-448321439f67 req-92d76ec7-0e22-4986-bb68-e808c82da27d service nova] Enqueued Resource ID: 5b54320b-d8ad-4e2d-b8c1-f8f15dccb0a9 with Priority: HIGHEST for action security_group_rules [ 1326.769590] env[65337]: INFO networking_nsxv3.common.synchronization [req-806a4d8f-a9b4-4dc7-8fa1-448321439f67 req-92d76ec7-0e22-4986-bb68-e808c82da27d service nova] Enqueued Resource ID: 5b54320b-d8ad-4e2d-b8c1-f8f15dccb0a9 with Priority: HIGHEST for action security_group_members [ 1326.769690] env[65337]: INFO networking_nsxv3.common.synchronization [req-806a4d8f-a9b4-4dc7-8fa1-448321439f67 req-92d76ec7-0e22-4986-bb68-e808c82da27d service nova] Enqueued Resource ID: e86942d6-20f2-4639-9318-1fca623ba0ff with Priority: HIGHEST for action port [ 1326.770600] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b54320b-d8ad-4e2d-b8c1-f8f15dccb0a9 with Priority: HIGHEST for action security_group_rules [ 1326.771270] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b54320b-d8ad-4e2d-b8c1-f8f15dccb0a9 with Priority: HIGHEST for action security_group_members [ 1326.771416] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e86942d6-20f2-4639-9318-1fca623ba0ff with Priority: HIGHEST for action port [ 1326.771719] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5b54320b-d8ad-4e2d-b8c1-f8f15dccb0a9 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.771865] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5b54320b-d8ad-4e2d-b8c1-f8f15dccb0a9" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.771938] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5b54320b-d8ad-4e2d-b8c1-f8f15dccb0a9" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.772164] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5b54320b-d8ad-4e2d-b8c1-f8f15dccb0a9" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.772253] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5b54320b-d8ad-4e2d-b8c1-f8f15dccb0a9',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1326.773338] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b54320b-d8ad-4e2d-b8c1-f8f15dccb0a9 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.773456] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b54320b-d8ad-4e2d-b8c1-f8f15dccb0a9" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.773525] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b54320b-d8ad-4e2d-b8c1-f8f15dccb0a9" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.773708] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b54320b-d8ad-4e2d-b8c1-f8f15dccb0a9" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.773876] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.773974] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.774061] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.774220] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.774310] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.774410] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b54320b-d8ad-4e2d-b8c1-f8f15dccb0a9',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1326.775159] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-e86942d6-20f2-4639-9318-1fca623ba0ff taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.775275] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e86942d6-20f2-4639-9318-1fca623ba0ff" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.775345] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e86942d6-20f2-4639-9318-1fca623ba0ff" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.775529] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e86942d6-20f2-4639-9318-1fca623ba0ff" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.775631] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e86942d6-20f2-4639-9318-1fca623ba0ff',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1327.277373] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b54320b-d8ad-4e2d-b8c1-f8f15dccb0a9 taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.277373] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b54320b-d8ad-4e2d-b8c1-f8f15dccb0a9" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.277666] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5b54320b-d8ad-4e2d-b8c1-f8f15dccb0a9',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1327.278402] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e86942d6-20f2-4639-9318-1fca623ba0ff with status ACTIVE [ 1327.278691] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.278874] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.278997] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.280404] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.280404] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.280404] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.280404] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.280404] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.280404] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.280404] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.280404] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.280946] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.280946] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.280946] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.280946] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.280946] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e86942d6-20f2-4639-9318-1fca623ba0ff is going to be updated. [ 1327.306254] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.306466] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.306466] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.306646] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.306781] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.307048] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e86942d6-20f2-4639-9318-1fca623ba0ff" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.783615] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5b54320b-d8ad-4e2d-b8c1-f8f15dccb0a9',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1327.900344] env[65337]: INFO networking_nsxv3.common.synchronization [req-9c080906-6fc8-4598-a143-554f1fc0219b req-701e2713-4ca1-4eb9-9619-cc35d5b0ab9b tempest-AttachVolumeShelveTestJSON-1101243143 tempest-AttachVolumeShelveTestJSON-1101243143-project-member] Enqueued Resource ID: a64509fd-193d-41f5-8257-21afcd1d96a2 with Priority: HIGHEST for action security_group_members [ 1327.900889] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a64509fd-193d-41f5-8257-21afcd1d96a2 with Priority: HIGHEST for action security_group_members [ 1327.901238] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-a64509fd-193d-41f5-8257-21afcd1d96a2 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.901392] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a64509fd-193d-41f5-8257-21afcd1d96a2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.901464] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a64509fd-193d-41f5-8257-21afcd1d96a2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.901660] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a64509fd-193d-41f5-8257-21afcd1d96a2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.901821] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.901908] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.901965] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.902160] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.902275] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.902387] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a64509fd-193d-41f5-8257-21afcd1d96a2',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1328.286612] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.286783] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.286783] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.287186] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.287351] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.287478] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b54320b-d8ad-4e2d-b8c1-f8f15dccb0a9 is going to be created. [ 1328.318868] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.319021] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.319100] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.319339] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.319499] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.330443] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b54320b-d8ad-4e2d-b8c1-f8f15dccb0a9 in Status: UNINITIALIZED for 2s [ 1328.405183] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.405412] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.405412] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.405631] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.425558] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.425821] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.425972] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.426054] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.426263] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.426374] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.426435] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a64509fd-193d-41f5-8257-21afcd1d96a2 is going to be updated. [ 1328.454502] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.454747] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.454747] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.454930] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.455059] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.463680] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a64509fd-193d-41f5-8257-21afcd1d96a2 in Status: IN_PROGRESS for 2s [ 1330.342308] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b54320b-d8ad-4e2d-b8c1-f8f15dccb0a9 in Status: SUCCESS [ 1330.342711] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b54320b-d8ad-4e2d-b8c1-f8f15dccb0a9" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.342826] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b54320b-d8ad-4e2d-b8c1-f8f15dccb0a9" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.343151] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b54320b-d8ad-4e2d-b8c1-f8f15dccb0a9" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.343435] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.343608] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.343717] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.343960] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.344090] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.344236] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b54320b-d8ad-4e2d-b8c1-f8f15dccb0a9" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.344385] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5b54320b-d8ad-4e2d-b8c1-f8f15dccb0a9',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1330.475981] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a64509fd-193d-41f5-8257-21afcd1d96a2 in Status: SUCCESS [ 1330.475981] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a64509fd-193d-41f5-8257-21afcd1d96a2 deletion is rescheduled due to dependency. [ 1330.475981] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a64509fd-193d-41f5-8257-21afcd1d96a2" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.847175] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5b54320b-d8ad-4e2d-b8c1-f8f15dccb0a9',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1331.350146] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5b54320b-d8ad-4e2d-b8c1-f8f15dccb0a9: rpc.has_security_group_logging(os_id): False [ 1331.368620] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.368884] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.368884] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.369054] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.369133] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.369444] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.369558] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.369624] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.369795] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.369872] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.369975] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5b54320b-d8ad-4e2d-b8c1-f8f15dccb0a9 is going to be created. [ 1331.432489] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.432772] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.432772] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.432904] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.433148] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.446995] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5b54320b-d8ad-4e2d-b8c1-f8f15dccb0a9 in Status: IN_PROGRESS for 2s [ 1332.210156] env[65337]: INFO networking_nsxv3.common.synchronization [req-043c6a08-6863-4265-ada0-679d8cf930e7 req-33755342-1700-423c-8d33-436c04459726 tempest-ServerActionsTestJSON-704073373 tempest-ServerActionsTestJSON-704073373-project-member] Enqueued Resource ID: 5f51b41c-ca91-45cf-92a6-17398a529bbb with Priority: HIGHEST for action security_group_members [ 1332.210610] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f51b41c-ca91-45cf-92a6-17398a529bbb with Priority: HIGHEST for action security_group_members [ 1332.210867] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f51b41c-ca91-45cf-92a6-17398a529bbb taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.211016] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f51b41c-ca91-45cf-92a6-17398a529bbb" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.211016] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f51b41c-ca91-45cf-92a6-17398a529bbb" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.211217] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f51b41c-ca91-45cf-92a6-17398a529bbb" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.211402] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.211511] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.211569] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.211732] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.211810] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.211906] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5f51b41c-ca91-45cf-92a6-17398a529bbb',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1332.530724] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock network-433 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.531127] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "network-433" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.531127] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "network-433" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.531349] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "network-433" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.531605] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.531773] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.531883] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.532200] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.532427] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.532674] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1332.532793] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1332.532902] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1332.533015] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1332.533147] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1332.533257] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1332.533587] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1332.556042] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1332.556042] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1332.556348] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1332.556496] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "network-433" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.557139] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock port-c4bce371-1d49-4b2a-b5c8-05722d5ff8a0 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.557346] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "port-c4bce371-1d49-4b2a-b5c8-05722d5ff8a0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.557560] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "port-c4bce371-1d49-4b2a-b5c8-05722d5ff8a0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.557943] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "port-c4bce371-1d49-4b2a-b5c8-05722d5ff8a0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.558143] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c4bce371-1d49-4b2a-b5c8-05722d5ff8a0',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1332.715906] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.716124] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.716175] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.716385] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.716482] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.716671] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.716772] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.717040] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.717215] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.717299] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.717390] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5f51b41c-ca91-45cf-92a6-17398a529bbb is going to be updated. [ 1332.744982] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.745176] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.745250] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.745459] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.745604] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.755929] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f51b41c-ca91-45cf-92a6-17398a529bbb in Status: IN_PROGRESS for 2s [ 1333.060710] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.061087] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.061234] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.061525] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.061674] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.061829] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Segment Port c4bce371-1d49-4b2a-b5c8-05722d5ff8a0 not found, creating... [ 1333.062104] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.062265] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.062381] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.062597] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.062733] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.063040] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.063188] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.063305] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.063516] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.063646] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.063783] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Resource: SegmentPort with ID: c4bce371-1d49-4b2a-b5c8-05722d5ff8a0 is going to be created. [ 1333.099398] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.099730] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.099899] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.100314] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.100653] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.100891] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "port-c4bce371-1d49-4b2a-b5c8-05722d5ff8a0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.458398] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5b54320b-d8ad-4e2d-b8c1-f8f15dccb0a9 in Status: SUCCESS [ 1333.458761] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5b54320b-d8ad-4e2d-b8c1-f8f15dccb0a9" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.771532] env[65337]: INFO networking_nsxv3.common.synchronization [req-043c6a08-6863-4265-ada0-679d8cf930e7 req-e5941d04-e58e-471e-a785-e9a3f7773bef service nova] Enqueued Resource ID: 5f51b41c-ca91-45cf-92a6-17398a529bbb with Priority: HIGHEST for action security_group_rules [ 1333.771801] env[65337]: INFO networking_nsxv3.common.synchronization [req-043c6a08-6863-4265-ada0-679d8cf930e7 req-e5941d04-e58e-471e-a785-e9a3f7773bef service nova] Enqueued Resource ID: 5f51b41c-ca91-45cf-92a6-17398a529bbb with Priority: HIGHEST for action security_group_members [ 1333.771844] env[65337]: INFO networking_nsxv3.common.synchronization [req-043c6a08-6863-4265-ada0-679d8cf930e7 req-e5941d04-e58e-471e-a785-e9a3f7773bef service nova] Enqueued Resource ID: c4bce371-1d49-4b2a-b5c8-05722d5ff8a0 with Priority: HIGHEST for action port [ 1333.772385] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f51b41c-ca91-45cf-92a6-17398a529bbb with Priority: HIGHEST for action security_group_rules [ 1333.772522] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f51b41c-ca91-45cf-92a6-17398a529bbb with Priority: HIGHEST for action security_group_members [ 1333.772616] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4bce371-1d49-4b2a-b5c8-05722d5ff8a0 with Priority: HIGHEST for action port [ 1333.772884] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5f51b41c-ca91-45cf-92a6-17398a529bbb taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.773187] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5f51b41c-ca91-45cf-92a6-17398a529bbb" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.773187] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5f51b41c-ca91-45cf-92a6-17398a529bbb" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.773366] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5f51b41c-ca91-45cf-92a6-17398a529bbb" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.773366] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5f51b41c-ca91-45cf-92a6-17398a529bbb',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1333.774657] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f51b41c-ca91-45cf-92a6-17398a529bbb taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.774795] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f51b41c-ca91-45cf-92a6-17398a529bbb" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.774975] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-c4bce371-1d49-4b2a-b5c8-05722d5ff8a0 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.775096] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c4bce371-1d49-4b2a-b5c8-05722d5ff8a0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.775163] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c4bce371-1d49-4b2a-b5c8-05722d5ff8a0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.775333] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c4bce371-1d49-4b2a-b5c8-05722d5ff8a0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.775412] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c4bce371-1d49-4b2a-b5c8-05722d5ff8a0',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1334.277089] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f51b41c-ca91-45cf-92a6-17398a529bbb taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.277333] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f51b41c-ca91-45cf-92a6-17398a529bbb" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.277465] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c4bce371-1d49-4b2a-b5c8-05722d5ff8a0 with status ACTIVE [ 1334.277632] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.277740] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.277804] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.278062] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.278161] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.278324] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.278420] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.278484] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.278643] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.278731] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.278913] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.279015] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.279088] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.279225] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.279280] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.279367] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c4bce371-1d49-4b2a-b5c8-05722d5ff8a0 is going to be updated. [ 1334.305516] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.305729] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.305729] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.305877] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.306173] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.306378] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c4bce371-1d49-4b2a-b5c8-05722d5ff8a0" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.768047] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f51b41c-ca91-45cf-92a6-17398a529bbb in Status: SUCCESS [ 1334.768047] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5f51b41c-ca91-45cf-92a6-17398a529bbb deletion is rescheduled due to dependency. [ 1334.768047] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f51b41c-ca91-45cf-92a6-17398a529bbb" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.768047] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f51b41c-ca91-45cf-92a6-17398a529bbb" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.768424] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f51b41c-ca91-45cf-92a6-17398a529bbb" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.768424] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.768546] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.768546] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.768701] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.768773] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.768875] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5f51b41c-ca91-45cf-92a6-17398a529bbb',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1335.271380] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5f51b41c-ca91-45cf-92a6-17398a529bbb',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1335.774137] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5f51b41c-ca91-45cf-92a6-17398a529bbb',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1336.277151] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1336.277590] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1336.277590] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1336.277879] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1336.278061] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.278255] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5f51b41c-ca91-45cf-92a6-17398a529bbb is going to be updated. [ 1336.325708] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1336.325867] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1336.325916] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1336.326170] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1336.326341] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.336368] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f51b41c-ca91-45cf-92a6-17398a529bbb in Status: IN_PROGRESS for 2s [ 1338.348313] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f51b41c-ca91-45cf-92a6-17398a529bbb in Status: SUCCESS [ 1338.348711] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f51b41c-ca91-45cf-92a6-17398a529bbb" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.348711] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f51b41c-ca91-45cf-92a6-17398a529bbb" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.348926] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f51b41c-ca91-45cf-92a6-17398a529bbb" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.349202] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.349344] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.349429] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.349625] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.349712] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.349803] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f51b41c-ca91-45cf-92a6-17398a529bbb" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.349896] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5f51b41c-ca91-45cf-92a6-17398a529bbb',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1338.774442] env[65337]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1338.774638] env[65337]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1338.851856] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5f51b41c-ca91-45cf-92a6-17398a529bbb',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1339.353923] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5f51b41c-ca91-45cf-92a6-17398a529bbb: rpc.has_security_group_logging(os_id): False [ 1339.372226] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.372403] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.372480] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.372689] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.372784] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.373066] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.373165] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.373226] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.373419] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.373475] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.373538] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5f51b41c-ca91-45cf-92a6-17398a529bbb is going to be updated. [ 1339.428294] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.428487] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.428487] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.428707] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.428851] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.442024] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5f51b41c-ca91-45cf-92a6-17398a529bbb in Status: IN_PROGRESS for 2s [ 1341.456260] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5f51b41c-ca91-45cf-92a6-17398a529bbb in Status: SUCCESS [ 1341.456615] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5f51b41c-ca91-45cf-92a6-17398a529bbb" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.775402] env[65337]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1343.775798] env[65337]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1348.776691] env[65337]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1348.777116] env[65337]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1353.777616] env[65337]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1353.778086] env[65337]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1358.778646] env[65337]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1358.779468] env[65337]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1363.780175] env[65337]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1363.780562] env[65337]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1368.781437] env[65337]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1368.781950] env[65337]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1373.782889] env[65337]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1373.783237] env[65337]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1376.209069] env[65337]: INFO networking_nsxv3.common.synchronization [req-ab649b89-376d-4803-a82c-bc289d46f722 req-127d97ee-648e-489c-86ba-a26ed55a125a tempest-ServerRescueNegativeTestJSON-59296460 tempest-ServerRescueNegativeTestJSON-59296460-project-member] Enqueued Resource ID: 303cb78d-3c85-4fcc-964c-f1082480bdd7 with Priority: HIGHEST for action security_group_members [ 1376.209830] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 303cb78d-3c85-4fcc-964c-f1082480bdd7 with Priority: HIGHEST for action security_group_members [ 1376.210403] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-303cb78d-3c85-4fcc-964c-f1082480bdd7 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1376.210585] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-303cb78d-3c85-4fcc-964c-f1082480bdd7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1376.210686] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-303cb78d-3c85-4fcc-964c-f1082480bdd7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1376.210955] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-303cb78d-3c85-4fcc-964c-f1082480bdd7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1376.211205] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1376.211809] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1376.211809] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1376.211809] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1376.211809] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1376.212124] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('303cb78d-3c85-4fcc-964c-f1082480bdd7',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1376.714320] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1376.714558] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1376.714558] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1376.714789] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1376.735540] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1376.735796] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1376.735913] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1376.735978] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1376.736275] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1376.736360] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1376.736455] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 303cb78d-3c85-4fcc-964c-f1082480bdd7 is going to be updated. [ 1376.762095] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1376.762321] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1376.762321] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1376.762534] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1376.762674] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1376.770885] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 303cb78d-3c85-4fcc-964c-f1082480bdd7 in Status: IN_PROGRESS for 2s [ 1378.781772] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 303cb78d-3c85-4fcc-964c-f1082480bdd7 in Status: SUCCESS [ 1378.782220] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 303cb78d-3c85-4fcc-964c-f1082480bdd7 deletion is rescheduled due to dependency. [ 1378.782220] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-303cb78d-3c85-4fcc-964c-f1082480bdd7" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1381.211426] env[65337]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1381.211819] env[65337]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1386.212808] env[65337]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1386.213246] env[65337]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1386.454893] env[65337]: INFO networking_nsxv3.common.synchronization [req-a289ac94-fce2-45af-b430-2396d06e0be3 req-cd8633ff-bcda-4d79-a464-f1e831b13125 tempest-AttachVolumeNegativeTest-935303807 tempest-AttachVolumeNegativeTest-935303807-project-member] Enqueued Resource ID: 5b54320b-d8ad-4e2d-b8c1-f8f15dccb0a9 with Priority: HIGHEST for action security_group_members [ 1386.455380] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b54320b-d8ad-4e2d-b8c1-f8f15dccb0a9 with Priority: HIGHEST for action security_group_members [ 1386.456156] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b54320b-d8ad-4e2d-b8c1-f8f15dccb0a9 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.456292] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b54320b-d8ad-4e2d-b8c1-f8f15dccb0a9" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.456362] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b54320b-d8ad-4e2d-b8c1-f8f15dccb0a9" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.456640] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b54320b-d8ad-4e2d-b8c1-f8f15dccb0a9" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.456812] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.456917] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.456982] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.457165] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.457293] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.457435] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b54320b-d8ad-4e2d-b8c1-f8f15dccb0a9',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1386.960238] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.960487] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.960487] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.960755] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.960869] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.961094] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.961203] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.961280] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.961452] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.961533] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.961620] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b54320b-d8ad-4e2d-b8c1-f8f15dccb0a9 is going to be updated. [ 1386.991995] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.992251] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.992304] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.992522] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.992671] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1387.001596] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b54320b-d8ad-4e2d-b8c1-f8f15dccb0a9 in Status: IN_PROGRESS for 2s [ 1387.873936] env[65337]: INFO networking_nsxv3.common.synchronization [req-fa087fab-2033-4211-8da8-1d21262a70b3 req-d38a5aa2-0970-4b8d-985f-eca6ef5873f7 tempest-ServerRescueNegativeTestJSON-59296460 tempest-ServerRescueNegativeTestJSON-59296460-project-member] Enqueued Resource ID: 846d69e3-9f9f-414f-912e-5a866002c853 with Priority: HIGHEST for action security_group_members [ 1387.874441] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 846d69e3-9f9f-414f-912e-5a866002c853 with Priority: HIGHEST for action security_group_members [ 1387.874776] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-846d69e3-9f9f-414f-912e-5a866002c853 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1387.874924] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-846d69e3-9f9f-414f-912e-5a866002c853" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1387.875046] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-846d69e3-9f9f-414f-912e-5a866002c853" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1387.875529] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-846d69e3-9f9f-414f-912e-5a866002c853" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1387.875725] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1387.875862] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1387.876018] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1387.876107] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1387.876202] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1387.876321] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('846d69e3-9f9f-414f-912e-5a866002c853',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1388.378748] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('846d69e3-9f9f-414f-912e-5a866002c853',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1388.882171] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('846d69e3-9f9f-414f-912e-5a866002c853',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1389.012732] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b54320b-d8ad-4e2d-b8c1-f8f15dccb0a9 in Status: SUCCESS [ 1389.013019] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b54320b-d8ad-4e2d-b8c1-f8f15dccb0a9 deletion is rescheduled due to dependency. [ 1389.013195] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b54320b-d8ad-4e2d-b8c1-f8f15dccb0a9" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.386063] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.386223] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.386223] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.386411] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.386506] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.386629] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 846d69e3-9f9f-414f-912e-5a866002c853 is going to be updated. [ 1389.416138] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.416298] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.416369] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.416584] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.416733] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.425479] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 846d69e3-9f9f-414f-912e-5a866002c853 in Status: IN_PROGRESS for 2s [ 1391.226306] env[65337]: INFO networking_nsxv3.common.synchronization [None req-8ba86996-27c9-449c-9e32-a49c3d409328 tempest-AttachVolumeNegativeTest-935303807 tempest-AttachVolumeNegativeTest-935303807-project-member] Enqueued Resource ID: 15de7c46-af21-47f4-95dd-341b60ac703b with Priority: HIGHEST for action security_group_rules [ 1391.227060] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15de7c46-af21-47f4-95dd-341b60ac703b with Priority: HIGHEST for action security_group_rules [ 1391.227307] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-15de7c46-af21-47f4-95dd-341b60ac703b taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1391.227484] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-15de7c46-af21-47f4-95dd-341b60ac703b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1391.227587] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-15de7c46-af21-47f4-95dd-341b60ac703b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.227863] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-15de7c46-af21-47f4-95dd-341b60ac703b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.227967] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('15de7c46-af21-47f4-95dd-341b60ac703b',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1391.320140] env[65337]: INFO networking_nsxv3.common.synchronization [None req-853ebf40-5a0a-4b6e-9362-5f833bc1a24c tempest-AttachVolumeNegativeTest-935303807 tempest-AttachVolumeNegativeTest-935303807-project-member] Enqueued Resource ID: 15de7c46-af21-47f4-95dd-341b60ac703b with Priority: HIGHEST for action security_group_rules [ 1391.320708] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15de7c46-af21-47f4-95dd-341b60ac703b with Priority: HIGHEST for action security_group_rules [ 1391.321187] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-15de7c46-af21-47f4-95dd-341b60ac703b taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1391.321519] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-15de7c46-af21-47f4-95dd-341b60ac703b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1391.437448] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 846d69e3-9f9f-414f-912e-5a866002c853 in Status: SUCCESS [ 1391.437639] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-846d69e3-9f9f-414f-912e-5a866002c853" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.747985] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1391.748177] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1391.748241] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.748414] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.748517] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.748594] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 15de7c46-af21-47f4-95dd-341b60ac703b already deleted. [ 1391.748674] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-15de7c46-af21-47f4-95dd-341b60ac703b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.748817] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-15de7c46-af21-47f4-95dd-341b60ac703b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.748964] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-15de7c46-af21-47f4-95dd-341b60ac703b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.749058] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('15de7c46-af21-47f4-95dd-341b60ac703b',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1392.269204] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.269646] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.269646] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.269646] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.269781] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.269781] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 15de7c46-af21-47f4-95dd-341b60ac703b already deleted. [ 1392.269848] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-15de7c46-af21-47f4-95dd-341b60ac703b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1395.133463] env[65337]: INFO networking_nsxv3.common.synchronization [req-99a0b36f-acfa-4f81-9c91-065f46f64089 req-e74bd0af-e437-4262-94ae-61b808c866a8 tempest-ServerRescueNegativeTestJSON-59296460 tempest-ServerRescueNegativeTestJSON-59296460-project-member] Enqueued Resource ID: 846d69e3-9f9f-414f-912e-5a866002c853 with Priority: HIGHEST for action security_group_members [ 1395.134030] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 846d69e3-9f9f-414f-912e-5a866002c853 with Priority: HIGHEST for action security_group_members [ 1395.134336] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-846d69e3-9f9f-414f-912e-5a866002c853 taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1395.134458] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-846d69e3-9f9f-414f-912e-5a866002c853" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.134516] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-846d69e3-9f9f-414f-912e-5a866002c853" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1395.134853] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-846d69e3-9f9f-414f-912e-5a866002c853" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1395.134853] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1395.135077] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.135077] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1395.135200] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1395.135282] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1395.135376] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('846d69e3-9f9f-414f-912e-5a866002c853',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1395.637518] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1395.637760] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.637760] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1395.637982] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1395.661927] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1395.662234] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1395.662360] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.662427] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1395.662633] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1395.662709] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1395.662798] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 846d69e3-9f9f-414f-912e-5a866002c853 is going to be updated. [ 1395.690071] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1395.690244] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.690293] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1395.690866] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1395.691034] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1395.699833] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 846d69e3-9f9f-414f-912e-5a866002c853 in Status: IN_PROGRESS for 2s [ 1396.625232] env[65337]: INFO networking_nsxv3.common.synchronization [req-bfb66376-5181-4405-87a0-2feeba024084 req-8ca68a79-4523-4297-b24b-6fc81e3c3eae tempest-AttachVolumeNegativeTest-935303807 tempest-AttachVolumeNegativeTest-935303807-project-member] Enqueued Resource ID: 15de7c46-af21-47f4-95dd-341b60ac703b with Priority: HIGHEST for action security_group_members [ 1396.625902] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15de7c46-af21-47f4-95dd-341b60ac703b with Priority: HIGHEST for action security_group_members [ 1396.626622] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-15de7c46-af21-47f4-95dd-341b60ac703b taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1396.626854] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15de7c46-af21-47f4-95dd-341b60ac703b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1396.627803] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15de7c46-af21-47f4-95dd-341b60ac703b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1396.628134] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15de7c46-af21-47f4-95dd-341b60ac703b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1396.632021] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1396.632021] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1396.632021] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1396.632021] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1396.632021] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1396.632021] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15de7c46-af21-47f4-95dd-341b60ac703b',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1396.896055] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock network-61 taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1396.896055] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "network-61" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1396.896055] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "network-61" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1396.896055] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "network-61" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1396.896309] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1396.896486] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1396.896646] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1396.896902] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1396.897088] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1396.897349] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1396.897461] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] NeedRegenerationException {{(pid=65337) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1396.897594] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] no value, waiting for create lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1396.897727] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] value creation lock acquired {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1396.897865] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] No value present for key: 'zone-id' {{(pid=65337) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1396.897996] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Calling creation function for not-yet-present value {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1396.898174] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1396.917490] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1396.917649] env[65337]: DEBUG dogpile.cache.region [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65337) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1396.917831] env[65337]: DEBUG dogpile.lock [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Released creation lock {{(pid=65337) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1396.918057] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "network-61" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1396.918428] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock port-e8c16bca-319f-42e6-8147-92168b3057df taken with stack trace [, , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1396.918625] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "port-e8c16bca-319f-42e6-8147-92168b3057df" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1396.918738] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "port-e8c16bca-319f-42e6-8147-92168b3057df" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1396.919060] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "port-e8c16bca-319f-42e6-8147-92168b3057df" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1396.919200] env[65337]: DEBUG networking_nsxv3.api.rpc [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e8c16bca-319f-42e6-8147-92168b3057df',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1397.130883] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1397.131098] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1397.131098] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1397.131337] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1397.131466] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1397.131737] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1397.131863] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1397.131932] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1397.132145] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1397.132254] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1397.132359] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15de7c46-af21-47f4-95dd-341b60ac703b already deleted. [ 1397.132452] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15de7c46-af21-47f4-95dd-341b60ac703b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1397.422334] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1397.422677] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1397.422677] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1397.422917] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1397.423077] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1397.423239] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Segment Port e8c16bca-319f-42e6-8147-92168b3057df not found, creating... [ 1397.423506] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1397.423663] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1397.423781] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1397.424102] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1397.424256] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1397.424539] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1397.424695] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1397.424808] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1397.425034] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1397.425309] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1397.425557] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Resource: SegmentPort with ID: e8c16bca-319f-42e6-8147-92168b3057df is going to be created. [ 1397.447113] env[65337]: INFO networking_nsxv3.common.synchronization [req-e086c792-6b15-427d-99ce-bf915ae7d215 req-afcf5ec5-22df-40ae-a126-e6522449f2b9 tempest-ServerActionsTestJSON-704073373 tempest-ServerActionsTestJSON-704073373-project-member] Enqueued Resource ID: 5f51b41c-ca91-45cf-92a6-17398a529bbb with Priority: HIGHEST for action security_group_members [ 1397.448847] env[65337]: DEBUG networking_nsxv3.common.locking [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1397.449333] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1397.449333] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1397.449690] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1397.450017] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1397.450354] env[65337]: DEBUG oslo_concurrency.lockutils [None req-83669334-8a77-46a2-91b6-9cb6d5adfcbd None None] Releasing lock "port-e8c16bca-319f-42e6-8147-92168b3057df" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1397.452325] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f51b41c-ca91-45cf-92a6-17398a529bbb with Priority: HIGHEST for action security_group_members [ 1397.453037] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f51b41c-ca91-45cf-92a6-17398a529bbb taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1397.453209] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f51b41c-ca91-45cf-92a6-17398a529bbb" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1397.453310] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f51b41c-ca91-45cf-92a6-17398a529bbb" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1397.453523] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f51b41c-ca91-45cf-92a6-17398a529bbb" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1397.453715] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1397.453847] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1397.453945] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1397.454149] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1397.454255] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1397.454376] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5f51b41c-ca91-45cf-92a6-17398a529bbb',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1397.710838] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 846d69e3-9f9f-414f-912e-5a866002c853 in Status: SUCCESS [ 1397.711240] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 846d69e3-9f9f-414f-912e-5a866002c853 deletion is rescheduled due to dependency. [ 1397.711240] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-846d69e3-9f9f-414f-912e-5a866002c853" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1397.956503] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1397.956654] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1397.956729] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1397.956982] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1397.957092] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1397.957441] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1397.957561] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1397.957627] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1397.957791] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1397.957870] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1397.957959] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5f51b41c-ca91-45cf-92a6-17398a529bbb is going to be updated. [ 1397.985937] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1397.986123] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1397.986172] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1397.986378] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1397.986544] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1397.994852] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f51b41c-ca91-45cf-92a6-17398a529bbb in Status: IN_PROGRESS for 2s [ 1398.142501] env[65337]: INFO networking_nsxv3.common.synchronization [req-bfb66376-5181-4405-87a0-2feeba024084 req-199ab6e2-b1fd-406a-a429-4c4a83a2b78a service nova] Enqueued Resource ID: 15de7c46-af21-47f4-95dd-341b60ac703b with Priority: HIGHEST for action security_group_rules [ 1398.142685] env[65337]: INFO networking_nsxv3.common.synchronization [req-bfb66376-5181-4405-87a0-2feeba024084 req-199ab6e2-b1fd-406a-a429-4c4a83a2b78a service nova] Enqueued Resource ID: 15de7c46-af21-47f4-95dd-341b60ac703b with Priority: HIGHEST for action security_group_members [ 1398.142822] env[65337]: INFO networking_nsxv3.common.synchronization [req-bfb66376-5181-4405-87a0-2feeba024084 req-199ab6e2-b1fd-406a-a429-4c4a83a2b78a service nova] Enqueued Resource ID: e8c16bca-319f-42e6-8147-92168b3057df with Priority: HIGHEST for action port [ 1398.143351] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15de7c46-af21-47f4-95dd-341b60ac703b with Priority: HIGHEST for action security_group_rules [ 1398.143494] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15de7c46-af21-47f4-95dd-341b60ac703b with Priority: HIGHEST for action security_group_members [ 1398.143593] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8c16bca-319f-42e6-8147-92168b3057df with Priority: HIGHEST for action port [ 1398.145989] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock rules-15de7c46-af21-47f4-95dd-341b60ac703b taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.146140] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-15de7c46-af21-47f4-95dd-341b60ac703b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.146210] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-15de7c46-af21-47f4-95dd-341b60ac703b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.146491] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-15de7c46-af21-47f4-95dd-341b60ac703b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.146577] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('15de7c46-af21-47f4-95dd-341b60ac703b',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1398.148319] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-15de7c46-af21-47f4-95dd-341b60ac703b taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.148473] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15de7c46-af21-47f4-95dd-341b60ac703b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.148546] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15de7c46-af21-47f4-95dd-341b60ac703b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.148741] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15de7c46-af21-47f4-95dd-341b60ac703b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.148898] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.148995] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.149070] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.149214] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.149287] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1398.149383] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15de7c46-af21-47f4-95dd-341b60ac703b',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1398.151066] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock port-e8c16bca-319f-42e6-8147-92168b3057df taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.151066] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e8c16bca-319f-42e6-8147-92168b3057df" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.151066] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e8c16bca-319f-42e6-8147-92168b3057df" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.151066] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e8c16bca-319f-42e6-8147-92168b3057df" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.151066] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e8c16bca-319f-42e6-8147-92168b3057df',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1398.649508] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-15de7c46-af21-47f4-95dd-341b60ac703b taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.649919] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15de7c46-af21-47f4-95dd-341b60ac703b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.651307] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('15de7c46-af21-47f4-95dd-341b60ac703b',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1398.652205] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e8c16bca-319f-42e6-8147-92168b3057df with status ACTIVE [ 1398.652404] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.652523] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.652587] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.652782] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.652870] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1398.653066] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.653162] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.653219] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.653367] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.653471] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1398.653667] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.653767] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.653826] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.653951] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.654077] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1398.654164] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e8c16bca-319f-42e6-8147-92168b3057df is going to be updated. [ 1398.681188] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.681407] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.681538] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.681901] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.682138] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1398.682387] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e8c16bca-319f-42e6-8147-92168b3057df" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1399.158857] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('15de7c46-af21-47f4-95dd-341b60ac703b',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1399.659721] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1399.659884] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1399.659933] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1399.660162] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1399.660253] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1399.660380] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15de7c46-af21-47f4-95dd-341b60ac703b is going to be created. [ 1399.683328] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1399.683661] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1399.683661] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1399.684100] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1399.684100] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1399.694290] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15de7c46-af21-47f4-95dd-341b60ac703b in Status: UNINITIALIZED for 2s [ 1400.005335] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f51b41c-ca91-45cf-92a6-17398a529bbb in Status: SUCCESS [ 1400.005524] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5f51b41c-ca91-45cf-92a6-17398a529bbb deletion is rescheduled due to dependency. [ 1400.005711] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f51b41c-ca91-45cf-92a6-17398a529bbb" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1401.704289] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15de7c46-af21-47f4-95dd-341b60ac703b in Status: SUCCESS [ 1401.704618] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15de7c46-af21-47f4-95dd-341b60ac703b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1401.704718] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15de7c46-af21-47f4-95dd-341b60ac703b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1401.704924] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15de7c46-af21-47f4-95dd-341b60ac703b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1401.705141] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1401.705334] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1401.705417] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1401.705566] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1401.705648] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1401.705734] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15de7c46-af21-47f4-95dd-341b60ac703b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1401.705825] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('15de7c46-af21-47f4-95dd-341b60ac703b',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1402.208790] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('15de7c46-af21-47f4-95dd-341b60ac703b',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1402.711390] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 15de7c46-af21-47f4-95dd-341b60ac703b: rpc.has_security_group_logging(os_id): False [ 1402.729966] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1402.730174] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1402.730242] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1402.730448] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1402.730539] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1402.730781] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1402.730881] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1402.730945] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1402.731151] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1402.731261] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1402.731329] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 15de7c46-af21-47f4-95dd-341b60ac703b is going to be created. [ 1402.794067] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1402.794305] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1402.794305] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1402.794508] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1402.794689] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1402.807022] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 15de7c46-af21-47f4-95dd-341b60ac703b in Status: IN_PROGRESS for 2s [ 1403.144956] env[65337]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1403.145330] env[65337]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1404.828093] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 15de7c46-af21-47f4-95dd-341b60ac703b in Status: SUCCESS [ 1404.828506] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-15de7c46-af21-47f4-95dd-341b60ac703b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1408.146918] env[65337]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1408.147352] env[65337]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1413.148187] env[65337]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1413.148700] env[65337]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1418.149609] env[65337]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1418.150065] env[65337]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1423.150722] env[65337]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1423.150722] env[65337]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1428.152490] env[65337]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1428.152490] env[65337]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1433.153931] env[65337]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1433.154223] env[65337]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1438.155064] env[65337]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1438.155064] env[65337]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1443.156047] env[65337]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1443.156343] env[65337]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1448.157824] env[65337]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1448.158246] env[65337]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1453.158898] env[65337]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1453.159215] env[65337]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1458.159739] env[65337]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1458.159739] env[65337]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1458.853561] env[65337]: INFO networking_nsxv3.common.synchronization [req-e43ba3c8-953f-46dd-ae89-3b02cd887b4e req-f79af1d8-0c85-472d-9ba9-2b9e20d9398d tempest-AttachVolumeNegativeTest-935303807 tempest-AttachVolumeNegativeTest-935303807-project-member] Enqueued Resource ID: 15de7c46-af21-47f4-95dd-341b60ac703b with Priority: HIGHEST for action security_group_members [ 1458.854123] env[65337]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15de7c46-af21-47f4-95dd-341b60ac703b with Priority: HIGHEST for action security_group_members [ 1458.854446] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock member-15de7c46-af21-47f4-95dd-341b60ac703b taken with stack trace [, , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1458.854577] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15de7c46-af21-47f4-95dd-341b60ac703b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1458.854644] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15de7c46-af21-47f4-95dd-341b60ac703b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1458.854908] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15de7c46-af21-47f4-95dd-341b60ac703b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1458.854999] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1458.855152] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1458.855213] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1458.855344] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1458.855402] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1458.855498] env[65337]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15de7c46-af21-47f4-95dd-341b60ac703b',) {} {{(pid=65337) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1459.360424] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1459.360857] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1459.360857] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1459.360941] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1459.360987] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1459.361208] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1459.361322] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1459.361381] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1459.361523] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1459.361602] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1459.361688] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15de7c46-af21-47f4-95dd-341b60ac703b is going to be updated. [ 1459.399775] env[65337]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65337) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1459.400034] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1459.400034] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1459.400210] env[65337]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1459.400356] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1459.409688] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15de7c46-af21-47f4-95dd-341b60ac703b in Status: IN_PROGRESS for 2s [ 1461.420579] env[65337]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15de7c46-af21-47f4-95dd-341b60ac703b in Status: SUCCESS [ 1461.421041] env[65337]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15de7c46-af21-47f4-95dd-341b60ac703b deletion is rescheduled due to dependency. [ 1461.421041] env[65337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15de7c46-af21-47f4-95dd-341b60ac703b" {{(pid=65337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1463.855014] env[65337]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1463.855416] env[65337]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1468.856143] env[65337]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1468.856545] env[65337]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1473.857471] env[65337]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1473.857947] env[65337]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1478.859073] env[65337]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1478.859456] env[65337]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1483.860234] env[65337]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1483.860234] env[65337]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1488.627984] env[65337]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-f81d39ac-7b08-4c21-a1c2-6484bc6252df None None] NSXv3 Agent Agent loop - iteration:3 completed [ 1488.628393] env[65337]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-f81d39ac-7b08-4c21-a1c2-6484bc6252df None None] NSXv3 Agent Agent loop - iteration:4 started [ 1488.861468] env[65337]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1488.861656] env[65337]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1493.862938] env[65337]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1493.863326] env[65337]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0